Nov 06 05:51:00 user nova-compute[74903]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74903) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 05:51:00 user nova-compute[74903]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74903) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 05:51:00 user nova-compute[74903]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74903) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 05:51:00 user nova-compute[74903]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:51:01 user nova-compute[74903]: INFO nova.virt.driver [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 06 05:51:01 user nova-compute[74903]: INFO nova.compute.provider_config [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Acquiring lock "singleton_lock" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Acquired lock "singleton_lock" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Releasing lock "singleton_lock" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Full set of CONF: {{(pid=74903) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ******************************************************************************** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Configuration options gathered from: {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ================================================================================ {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] allow_resize_to_same_host      = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] arq_binding_timeout            = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] backdoor_port                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] backdoor_socket                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] block_device_allocate_retries  = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] block_device_allocate_retries_interval = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cert                           = self.pem {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute_monitors               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] config_dir                     = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] config_drive_format            = iso9660 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] config_source                  = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] console_host                   = user {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] control_exchange               = nova {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cpu_allocation_ratio           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] daemon                         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] debug                          = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_access_ip_network_name = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_availability_zone      = nova {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_ephemeral_format       = ext4 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_green_pool_size        = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] default_schedule_zone          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] disk_allocation_ratio          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] enable_new_services            = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] enabled_apis                   = ['osapi_compute'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] enabled_ssl_apis               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] flat_injected                  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] force_config_drive             = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] force_raw_images               = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] graceful_shutdown_timeout      = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] heal_instance_info_cache_interval = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] host                           = user {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_build_timeout         = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_delete_interval       = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_format                = [instance: %(uuid)s]  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_name_template         = instance-%08x {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_usage_audit           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_usage_audit_period    = month {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] internal_service_availability_zone = internal {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] key                            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] live_migration_retry_count     = 30 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_config_append              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_dir                        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_file                       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_options                    = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_rotate_interval            = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_rotate_interval_type       = days {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] log_rotation_type              = none {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] long_rpc_timeout               = 1800 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_concurrent_builds          = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_concurrent_live_migrations = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_concurrent_snapshots       = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_local_block_devices        = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_logfile_count              = 30 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] max_logfile_size_mb            = 200 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] maximum_instance_delete_attempts = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metadata_listen                = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metadata_listen_port           = 8775 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metadata_workers               = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] migrate_max_retries            = -1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] mkisofs_cmd                    = genisoimage {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] my_ip                          = 10.0.0.210 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] network_allocate_retries       = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] osapi_compute_listen_port      = 8774 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] osapi_compute_unique_server_name_scope =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] osapi_compute_workers          = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] password_length                = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] periodic_enable                = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] periodic_fuzzy_delay           = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] pointer_model                  = ps2mouse {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] preallocate_images             = none {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] publish_errors                 = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] pybasedir                      = /opt/stack/nova {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ram_allocation_ratio           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rate_limit_burst               = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rate_limit_except_level        = CRITICAL {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rate_limit_interval            = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reboot_timeout                 = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reclaim_instance_interval      = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] record                         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reimage_timeout_per_gb         = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] report_interval                = 120 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rescue_timeout                 = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reserved_host_cpus             = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reserved_host_disk_mb          = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reserved_host_memory_mb        = 512 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] reserved_huge_pages            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] resize_confirm_window          = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] resize_fs_using_block_device   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] resume_guests_state_on_host_boot = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rpc_response_timeout           = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] run_external_periodic_tasks    = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] running_deleted_instance_action = reap {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] running_deleted_instance_poll_interval = 1800 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] running_deleted_instance_timeout = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler_instance_sync_interval = 120 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_down_time              = 720 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] servicegroup_driver            = db {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] shelved_offload_time           = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] shelved_poll_interval          = 3600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] shutdown_timeout               = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] source_is_ipv6                 = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ssl_only                       = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] state_path                     = /opt/stack/data/nova {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] sync_power_state_interval      = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] sync_power_state_pool_size     = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] syslog_log_facility            = LOG_USER {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] tempdir                        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] timeout_nbd                    = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] transport_url                  = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] update_resources_interval      = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_cow_images                 = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_eventlog                   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_journal                    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_json                       = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_rootwrap_daemon            = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_stderr                     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] use_syslog                     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vcpu_pin_set                   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plugging_is_fatal          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plugging_timeout           = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] virt_mkfs                      = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] volume_usage_poll_interval     = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] watch_log_file                 = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] web                            = /usr/share/spice-html5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_concurrency.disable_process_locking = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.auth_strategy              = keystone {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.compute_link_prefix        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.dhcp_domain                = novalocal {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.enable_instance_password   = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.glance_link_prefix         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.instance_list_per_project_cells = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.list_records_by_skipping_down_cells = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.local_metadata_per_cell    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.max_limit                  = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.metadata_cache_expiration  = 15 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.neutron_default_tenant_id  = default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.use_forwarded_for          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.use_neutron_default_nets   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_dynamic_targets = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_jsonfile_path   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.backend                  = dogpile.cache.memcached {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.backend_argument         = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.config_prefix            = cache.oslo {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.dead_timeout             = 60.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.debug_cache_backend      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.enable_retry_client      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.enable_socket_keepalive  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.enabled                  = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.expiration_time          = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.hashclient_retry_attempts = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_dead_retry      = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_password        =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_pool_maxsize    = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_sasl_enabled    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.memcache_username        =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.proxies                  = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.retry_attempts           = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.retry_delay              = 0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.socket_keepalive_count   = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.socket_keepalive_idle    = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.socket_keepalive_interval = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.tls_allowed_ciphers      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.tls_cafile               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.tls_certfile             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.tls_enabled              = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cache.tls_keyfile              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.auth_section            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.auth_type               = password {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.cafile                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.certfile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.collect_timing          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.cross_az_attach         = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.debug                   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.endpoint_template       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.http_retries            = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.insecure                = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.keyfile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.os_region_name          = RegionOne {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.split_loggers           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cinder.timeout                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.cpu_dedicated_set      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.cpu_shared_set         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.image_type_exclude_list = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.max_concurrent_disk_ops = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.max_disk_devices_to_attach = -1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.resource_provider_association_refresh = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.shutdown_retry_interval = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] conductor.workers              = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] console.allowed_origins        = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] console.ssl_ciphers            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] console.ssl_minimum_version    = default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] consoleauth.token_ttl          = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.cafile                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.certfile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.collect_timing          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.connect_retries         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.connect_retry_delay     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.endpoint_override       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.insecure                = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.keyfile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.max_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.min_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.region_name             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.service_name            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.service_type            = accelerator {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.split_loggers           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.status_code_retries     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.timeout                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] cyborg.version                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.backend               = sqlalchemy {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.connection            = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.connection_debug      = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.connection_parameters =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.connection_recycle_time = 3600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.connection_trace      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.db_inc_retry_interval = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.db_max_retries        = 20 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.db_max_retry_interval = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.db_retry_interval     = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.max_overflow          = 50 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.max_pool_size         = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.max_retries           = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.mysql_wsrep_sync_wait = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.pool_timeout          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.retry_interval        = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.slave_connection      = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] database.sqlite_synchronous    = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.backend           = sqlalchemy {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.connection        = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.connection_debug  = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.connection_parameters =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.connection_recycle_time = 3600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.connection_trace  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.db_inc_retry_interval = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.db_max_retries    = 20 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.db_max_retry_interval = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.db_retry_interval = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.max_overflow      = 50 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.max_pool_size     = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.max_retries       = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.pool_timeout      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.retry_interval    = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.slave_connection  = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] api_database.sqlite_synchronous = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] devices.enabled_mdev_types     = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ephemeral_storage_encryption.enabled = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.api_servers             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.cafile                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.certfile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.collect_timing          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.connect_retries         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.connect_retry_delay     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.debug                   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.default_trusted_certificate_ids = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.enable_certificate_validation = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.enable_rbd_download     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.endpoint_override       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.insecure                = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.keyfile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.max_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.min_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.num_retries             = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.rbd_ceph_conf           =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.rbd_connect_timeout     = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.rbd_pool                =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.rbd_user                =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.region_name             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.service_name            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.service_type            = image {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.split_loggers           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.status_code_retries     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.timeout                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.verify_glance_signatures = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] glance.version                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] guestfs.debug                  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.config_drive_cdrom      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.config_drive_inject_password = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.enable_instance_metrics_collection = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.enable_remotefx         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.instances_path_share    =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.iscsi_initiator_list    = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.limit_cpu_features      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.power_state_check_timeframe = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.use_multipath_io        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.volume_attach_retry_count = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.vswitch_name            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] mks.enabled                    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.manager_interval   = 2400 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.precache_concurrency = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.remove_unused_base_images = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] image_cache.subdirectory_name  = _base {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.api_max_retries         = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.api_retry_interval      = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.auth_section            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.auth_type               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.cafile                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.certfile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.collect_timing          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.conductor_group         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.connect_retries         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.connect_retry_delay     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.endpoint_override       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.insecure                = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.keyfile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.max_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.min_version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.peer_list               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.region_name             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.serial_console_state_timeout = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.service_name            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.service_type            = baremetal {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.split_loggers           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.status_code_retries     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.timeout                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ironic.version                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] key_manager.fixed_key          = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.barbican_api_version  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.barbican_endpoint     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.barbican_endpoint_type = public {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.barbican_region_name  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.cafile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.certfile              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.collect_timing        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.insecure              = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.keyfile               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.number_of_retries     = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.retry_delay           = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.send_service_user_token = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.split_loggers         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.timeout               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.verify_ssl            = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican.verify_ssl_path       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.auth_section = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.auth_type = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.cafile   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.certfile = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.collect_timing = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.insecure = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.keyfile  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.split_loggers = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] barbican_service_user.timeout  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.approle_role_id          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.approle_secret_id        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.cafile                   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.certfile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.collect_timing           = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.insecure                 = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.keyfile                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.kv_mountpoint            = secret {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.kv_path                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.kv_version               = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.namespace                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.root_token_id            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.split_loggers            = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.ssl_ca_crt_file          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.timeout                  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.use_ssl                  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.auth_section          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.auth_type             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.cafile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.certfile              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.collect_timing        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.connect_retries       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.connect_retry_delay   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.endpoint_override     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.insecure              = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.keyfile               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.max_version           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.min_version           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.region_name           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.service_name          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.service_type          = identity {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.split_loggers         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.status_code_retries   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.timeout               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] keystone.version               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.connection_uri         =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_mode               = custom {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: WARNING oslo_config.cfg [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_power_governor_high = performance {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_power_governor_low = powersave {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_power_management   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.device_detach_attempts = 8 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.device_detach_timeout  = 20 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.disk_cachemodes        = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.disk_prefix            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.enabled_perf_events    = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.file_backed_memory     = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.gid_maps               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.hw_disk_discard        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.hw_machine_type        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_rbd_glance_store_name =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_rbd_pool        = rbd {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_type            = default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.images_volume_group    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.inject_key             = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.inject_partition       = -2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.inject_password        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.iscsi_iface            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.iser_use_multipath     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_bandwidth = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_downtime = 500 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_inbound_addr = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_permit_post_copy = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_scheme  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_timeout_action = abort {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_tunnelled = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: WARNING oslo_config.cfg [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 06 05:51:01 user nova-compute[74903]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 06 05:51:01 user nova-compute[74903]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 06 05:51:01 user nova-compute[74903]: and ``live_migration_inbound_addr`` respectively.
Nov 06 05:51:01 user nova-compute[74903]: ).  Its value may be silently ignored in the future.
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.live_migration_with_native_tls = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.max_queues             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.nfs_mount_options      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_memory_encrypted_guests = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_pcie_ports         = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.pmem_namespaces        = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.quobyte_client_cfg     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rbd_secret_uuid        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rbd_user               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.remote_filesystem_transport = ssh {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rescue_image_id        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rescue_kernel_id       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rescue_ramdisk_id      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.rx_queue_size          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.smbfs_mount_options    =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.snapshot_compression   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.snapshot_image_format  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.sparse_logical_volumes = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.swtpm_enabled          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.swtpm_group            = tss {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.swtpm_user             = tss {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.sysinfo_serial         = unique {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.tb_cache_size          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.tx_queue_size          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.uid_maps               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.use_virtio_for_bridges = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.virt_type              = kvm {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.volume_clear           = zero {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.volume_clear_size      = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.volume_use_multipath   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_cache_path   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.vzstorage_mount_user   = stack {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.auth_section           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.auth_type              = password {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.cafile                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.certfile               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.collect_timing         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.connect_retries        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.connect_retry_delay    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.default_floating_pool  = public {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.endpoint_override      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.extension_sync_interval = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.http_retries           = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.insecure               = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.keyfile                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.max_version            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.min_version            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.ovs_bridge             = br-int {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.physnets               = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.region_name            = RegionOne {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.service_metadata_proxy = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.service_name           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.service_type           = network {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.split_loggers          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.status_code_retries    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.timeout                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] neutron.version                = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] notifications.bdms_in_notifications = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] notifications.default_level    = INFO {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] notifications.notification_format = unversioned {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] notifications.notify_on_state_change = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] pci.alias                      = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] pci.device_spec                = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] pci.report_in_placement        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.auth_section         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.auth_type            = password {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.cafile               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.certfile             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.collect_timing       = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.connect_retries      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.connect_retry_delay  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.default_domain_id    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.default_domain_name  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.domain_id            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.domain_name          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.endpoint_override    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.insecure             = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.keyfile              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.max_version          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.min_version          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.password             = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.project_domain_id    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.project_domain_name  = Default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.project_id           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.project_name         = service {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.region_name          = RegionOne {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.service_name         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.service_type         = placement {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.split_loggers        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.status_code_retries  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.system_scope         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.timeout              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.trust_id             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.user_domain_id       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.user_domain_name     = Default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.user_id              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.username             = placement {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] placement.version              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.cores                    = 20 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.count_usage_from_placement = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.injected_file_content_bytes = 10240 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.injected_file_path_length = 255 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.injected_files           = 5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.instances                = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.key_pairs                = 100 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.metadata_items           = 128 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.ram                      = 51200 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.recheck_quota            = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.server_group_members     = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] quota.server_groups            = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rdp.enabled                    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.image_metadata_prefilter = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.max_attempts         = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.max_placement_results = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.query_placement_for_image_type_support = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] scheduler.workers              = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.host_subset_size = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.isolated_hosts = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.isolated_images = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.pci_in_placement = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.track_instance_changes = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metrics.required               = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metrics.weight_multiplier      = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] metrics.weight_setting         = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.enabled         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.port_range      = 10000:20000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] serial_console.serialproxy_port = 6083 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.auth_section      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.auth_type         = password {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.cafile            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.certfile          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.collect_timing    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.insecure          = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.keyfile           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.send_service_user_token = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.split_loggers     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] service_user.timeout           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.agent_enabled            = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.enabled                  = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.html5proxy_port          = 6082 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.image_compression        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.jpeg_compression         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.playback_compression     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.server_listen            = 127.0.0.1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.streaming_mode           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] spice.zlib_compression         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] upgrade_levels.baseapi         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] upgrade_levels.cert            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] upgrade_levels.compute         = auto {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] upgrade_levels.conductor       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] upgrade_levels.scheduler       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.auth_section = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.auth_type = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.cafile = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.certfile = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.insecure = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.keyfile = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vendordata_dynamic_auth.timeout = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.api_retry_count         = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.ca_file                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.cache_prefix            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.cluster_name            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.connection_pool_size    = 10 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.console_delay_seconds   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.datastore_regex         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.host_ip                 = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.host_password           = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.host_port               = 443 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.host_username           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.insecure                = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.integration_bridge      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.maximum_objects         = 100 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.pbm_default_policy      = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.pbm_enabled             = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.pbm_wsdl_location       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.serial_port_proxy_uri   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.serial_port_service_uri = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.task_poll_interval      = 0.5 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.use_linked_clone        = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.vnc_keymap              = en-us {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.vnc_port                = 5900 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vmware.vnc_port_total          = 10000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.auth_schemes               = ['none'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.enabled                    = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.novncproxy_port            = 6080 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.server_listen              = 0.0.0.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.vencrypt_ca_certs          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.vencrypt_client_cert       = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vnc.vencrypt_client_key        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.disable_rootwrap   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.enable_numa_live_migration = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.libvirt_disable_apic = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.client_socket_timeout     = 900 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.default_pool_size         = 1000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.keep_alive                = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.max_header_line           = 16384 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.ssl_ca_file               = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.ssl_cert_file             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.ssl_key_file              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.tcp_keepidle              = 600 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] zvm.ca_file                    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] zvm.cloud_connector_url        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] zvm.reachable_timeout          = 300 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.enforce_new_defaults = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.enforce_scope      = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.policy_default_rule = default {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.policy_file        = policy.yaml {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.connection_string     = messaging:// {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.enabled               = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.es_doc_type           = notification {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.es_scroll_size        = 10000 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.es_scroll_time        = 2m {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.filter_error_trace    = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.hmac_keys             = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.sentinel_service_name = mymaster {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.socket_timeout        = 0.1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.trace_requests        = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler.trace_sqlalchemy      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler_jaeger.process_tags   = {} {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler_jaeger.service_name_prefix = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] profiler_otlp.service_name_prefix = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] remote_debug.host              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] remote_debug.port              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_notifications.retry = -1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.auth_section        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.auth_type           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.cafile              = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.certfile            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.collect_timing      = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.connect_retries     = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.connect_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.endpoint_id         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.endpoint_override   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.insecure            = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.keyfile             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.max_version         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.min_version         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.region_name         = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.service_name        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.service_type        = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.split_loggers       = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.status_code_retries = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.status_code_retry_delay = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.timeout             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.valid_interfaces    = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_limit.version             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_reports.file_event_handler = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] oslo_reports.log_dir           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.group  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] vif_plug_ovs_privileged.user   = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.flat_interface = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.isolate_vif         = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_vif_ovs.per_port_bridge     = False {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] os_brick.lock_path             = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.capabilities   = [21] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.group          = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.helper_command = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] privsep_osbrick.user           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.group           = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.helper_command  = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] nova_sys_admin.user            = None {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG oslo_service.service [None req-5bf3d3aa-2739-4f58-8014-0fca58c691ba None None] ******************************************************************************** {{(pid=74903) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 06 05:51:01 user nova-compute[74903]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Connecting to libvirt: qemu:///system {{(pid=74903) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7faa48a37010> {{(pid=74903) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 06 05:51:01 user nova-compute[74903]: libvirt:  error : internal error: could not initialize domain event timer
Nov 06 05:51:01 user nova-compute[74903]: WARNING nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7faa48a37010> {{(pid=74903) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Starting native event thread {{(pid=74903) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Starting green dispatch thread {{(pid=74903) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Starting connection event dispatch thread {{(pid=74903) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 06 05:51:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Connection event '1' reason 'None'
Nov 06 05:51:01 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 05:51:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.mount [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Initialising _HostMountState generation 0 {{(pid=74903) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 06 05:51:09 user nova-compute[74903]: INFO nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host capabilities <capabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <host>
Nov 06 05:51:09 user nova-compute[74903]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 06 05:51:09 user nova-compute[74903]:     <cpu>
Nov 06 05:51:09 user nova-compute[74903]:       <arch>x86_64</arch>
Nov 06 05:51:09 user nova-compute[74903]:       <model>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <microcode version='1070'/>
Nov 06 05:51:09 user nova-compute[74903]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='osxsave'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='invtsc'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='rsba'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature name='skip-l1dfl-vmentry'/>
Nov 06 05:51:09 user nova-compute[74903]:       <pages unit='KiB' size='4'/>
Nov 06 05:51:09 user nova-compute[74903]:       <pages unit='KiB' size='2048'/>
Nov 06 05:51:09 user nova-compute[74903]:     </cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <power_management>
Nov 06 05:51:09 user nova-compute[74903]:       <suspend_mem/>
Nov 06 05:51:09 user nova-compute[74903]:       <suspend_disk/>
Nov 06 05:51:09 user nova-compute[74903]:       <suspend_hybrid/>
Nov 06 05:51:09 user nova-compute[74903]:     </power_management>
Nov 06 05:51:09 user nova-compute[74903]:     <iommu support='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <migration_features>
Nov 06 05:51:09 user nova-compute[74903]:       <live/>
Nov 06 05:51:09 user nova-compute[74903]:       <uri_transports>
Nov 06 05:51:09 user nova-compute[74903]:         <uri_transport>tcp</uri_transport>
Nov 06 05:51:09 user nova-compute[74903]:         <uri_transport>rdma</uri_transport>
Nov 06 05:51:09 user nova-compute[74903]:       </uri_transports>
Nov 06 05:51:09 user nova-compute[74903]:     </migration_features>
Nov 06 05:51:09 user nova-compute[74903]:     <topology>
Nov 06 05:51:09 user nova-compute[74903]:       <cells num='2'>
Nov 06 05:51:09 user nova-compute[74903]:         <cell id='0'>
Nov 06 05:51:09 user nova-compute[74903]:           <memory unit='KiB'>8189224</memory>
Nov 06 05:51:09 user nova-compute[74903]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 06 05:51:09 user nova-compute[74903]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 05:51:09 user nova-compute[74903]:           <distances>
Nov 06 05:51:09 user nova-compute[74903]:             <sibling id='0' value='10'/>
Nov 06 05:51:09 user nova-compute[74903]:             <sibling id='1' value='20'/>
Nov 06 05:51:09 user nova-compute[74903]:           </distances>
Nov 06 05:51:09 user nova-compute[74903]:           <cpus num='6'>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 06 05:51:09 user nova-compute[74903]:           </cpus>
Nov 06 05:51:09 user nova-compute[74903]:         </cell>
Nov 06 05:51:09 user nova-compute[74903]:         <cell id='1'>
Nov 06 05:51:09 user nova-compute[74903]:           <memory unit='KiB'>8206460</memory>
Nov 06 05:51:09 user nova-compute[74903]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 06 05:51:09 user nova-compute[74903]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 05:51:09 user nova-compute[74903]:           <distances>
Nov 06 05:51:09 user nova-compute[74903]:             <sibling id='0' value='20'/>
Nov 06 05:51:09 user nova-compute[74903]:             <sibling id='1' value='10'/>
Nov 06 05:51:09 user nova-compute[74903]:           </distances>
Nov 06 05:51:09 user nova-compute[74903]:           <cpus num='6'>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 06 05:51:09 user nova-compute[74903]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 06 05:51:09 user nova-compute[74903]:           </cpus>
Nov 06 05:51:09 user nova-compute[74903]:         </cell>
Nov 06 05:51:09 user nova-compute[74903]:       </cells>
Nov 06 05:51:09 user nova-compute[74903]:     </topology>
Nov 06 05:51:09 user nova-compute[74903]:     <cache>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 06 05:51:09 user nova-compute[74903]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 06 05:51:09 user nova-compute[74903]:     </cache>
Nov 06 05:51:09 user nova-compute[74903]:     <secmodel>
Nov 06 05:51:09 user nova-compute[74903]:       <model>apparmor</model>
Nov 06 05:51:09 user nova-compute[74903]:       <doi>0</doi>
Nov 06 05:51:09 user nova-compute[74903]:     </secmodel>
Nov 06 05:51:09 user nova-compute[74903]:     <secmodel>
Nov 06 05:51:09 user nova-compute[74903]:       <model>dac</model>
Nov 06 05:51:09 user nova-compute[74903]:       <doi>0</doi>
Nov 06 05:51:09 user nova-compute[74903]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 06 05:51:09 user nova-compute[74903]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 06 05:51:09 user nova-compute[74903]:     </secmodel>
Nov 06 05:51:09 user nova-compute[74903]:   </host>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='alpha'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>clipper</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='armv6l'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>spitz</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>nuri</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>kzm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>z2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>tosa</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n810</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>terrier</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>midway</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>microbit</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>verdex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>highbank</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>akita</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>connex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>collie</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='armv7l'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>spitz</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>nuri</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>kzm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>z2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>tosa</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n810</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>terrier</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>midway</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>microbit</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>verdex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>highbank</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>akita</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>connex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>collie</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='aarch64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>spitz</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>nuri</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>kzm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>z2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>tosa</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n810</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>n800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>terrier</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>midway</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>microbit</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>verdex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>raspi3b</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>highbank</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>akita</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>connex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>collie</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <acpi default='on' toggle='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='cris'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='i686'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>isapc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>microvm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='kvm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <pae/>
Nov 06 05:51:09 user nova-compute[74903]:       <nonpae/>
Nov 06 05:51:09 user nova-compute[74903]:       <acpi default='on' toggle='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:       <apic default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='m68k'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>an5206</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>q800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>next-cube</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='microblaze'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='microblazeel'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='mips'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>malta</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='mipsel'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>malta</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='mips64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>malta</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>pica61</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>magnum</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='mips64el'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>malta</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>pica61</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>magnum</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='16'>boston</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='ppc'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mac99</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>40p</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>taihu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='ppc64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>taihu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>40p</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mac99</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='ppc64le'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>taihu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>40p</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>mac99</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='riscv32'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='8'>spike</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>opentitan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='8'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='riscv64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='8'>spike</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>shakti_c</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='8'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='s390x'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='sh4'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>shix</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>r2d</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='sh4eb'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>shix</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>r2d</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='sparc'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>SS-5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>SS-20</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>LX</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>SS-4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>SS-10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>Voyager</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='sparc64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sun4u</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>niagara</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>sun4v</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='x86_64'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>64</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='1'>isapc</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>microvm</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='kvm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <acpi default='on' toggle='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:       <apic default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='xtensa'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>sim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>kc705</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ml605</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx200</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx60</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]:   <guest>
Nov 06 05:51:09 user nova-compute[74903]:     <os_type>hvm</os_type>
Nov 06 05:51:09 user nova-compute[74903]:     <arch name='xtensaeb'>
Nov 06 05:51:09 user nova-compute[74903]:       <wordsize>32</wordsize>
Nov 06 05:51:09 user nova-compute[74903]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='4'>sim</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>kc705</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ml605</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>virt</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx200</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>lx60</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 05:51:09 user nova-compute[74903]:       <domain type='qemu'/>
Nov 06 05:51:09 user nova-compute[74903]:     </arch>
Nov 06 05:51:09 user nova-compute[74903]:     <features>
Nov 06 05:51:09 user nova-compute[74903]:       <cpuselection/>
Nov 06 05:51:09 user nova-compute[74903]:       <deviceboot/>
Nov 06 05:51:09 user nova-compute[74903]:       <disksnapshot default='on' toggle='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     </features>
Nov 06 05:51:09 user nova-compute[74903]:   </guest>
Nov 06 05:51:09 user nova-compute[74903]: </capabilities>
Nov 06 05:51:09 user nova-compute[74903]: 
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-q35-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>i686</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='288'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'/>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='lm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-i440fx-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>i686</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='255'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'/>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='lm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ide</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-q35-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>i686</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='288'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'/>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='lm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-i440fx-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>i686</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='255'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'/>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='lm'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ide</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-q35-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>x86_64</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='288'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>efi</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='invtsc'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='rsba'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-i440fx-jammy</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>x86_64</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='255'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>efi</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='invtsc'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='rsba'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ide</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-q35-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>x86_64</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='288'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>efi</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='invtsc'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='rsba'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 06 05:51:09 user nova-compute[74903]: <domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 05:51:09 user nova-compute[74903]:   <domain>kvm</domain>
Nov 06 05:51:09 user nova-compute[74903]:   <machine>pc-i440fx-6.2</machine>
Nov 06 05:51:09 user nova-compute[74903]:   <arch>x86_64</arch>
Nov 06 05:51:09 user nova-compute[74903]:   <vcpu max='255'/>
Nov 06 05:51:09 user nova-compute[74903]:   <iothreads supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:   <os supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='firmware'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>efi</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:     <loader supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>rom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pflash</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='readonly'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>yes</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='secure'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>no</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </loader>
Nov 06 05:51:09 user nova-compute[74903]:   </os>
Nov 06 05:51:09 user nova-compute[74903]:   <cpu>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-passthrough' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='hostPassthroughMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='maximum' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='maximumMigratable'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>on</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>off</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='host-model' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <vendor>Intel</vendor>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ss'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='vmx'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pcid'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='hypervisor'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arat'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='umip'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='md-clear'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='invtsc'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibpb'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='ibrs'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-stibp'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='rsba'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='erms'/>
Nov 06 05:51:09 user nova-compute[74903]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:     <mode name='custom' supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>qemu64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>qemu32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>phenom</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>pentium</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>n270</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm64</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>kvm32</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>coreduo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>core2duo</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>athlon</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Westmere</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Snowridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Skylake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>SandyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Penryn</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G5</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G4</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G3</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Opteron_G2</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Opteron_G1</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>IvyBridge</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Icelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Haswell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Rome</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-Milan</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>EPYC</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Dhyana</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cooperlake</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>Conroe</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='no'>Broadwell</model>
Nov 06 05:51:09 user nova-compute[74903]:       <model usable='yes'>486</model>
Nov 06 05:51:09 user nova-compute[74903]:     </mode>
Nov 06 05:51:09 user nova-compute[74903]:   </cpu>
Nov 06 05:51:09 user nova-compute[74903]:   <memoryBacking supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:     <enum name='sourceType'>
Nov 06 05:51:09 user nova-compute[74903]:       <value>file</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>anonymous</value>
Nov 06 05:51:09 user nova-compute[74903]:       <value>memfd</value>
Nov 06 05:51:09 user nova-compute[74903]:     </enum>
Nov 06 05:51:09 user nova-compute[74903]:   </memoryBacking>
Nov 06 05:51:09 user nova-compute[74903]:   <devices>
Nov 06 05:51:09 user nova-compute[74903]:     <disk supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='diskDevice'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>disk</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cdrom</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>floppy</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>lun</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='bus'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ide</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>fdc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sata</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </disk>
Nov 06 05:51:09 user nova-compute[74903]:     <graphics supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='type'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>sdl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vnc</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>spice</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egl-headless</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </graphics>
Nov 06 05:51:09 user nova-compute[74903]:     <video supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='modelType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>cirrus</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>vmvga</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>qxl</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>none</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>bochs</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>ramfb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </video>
Nov 06 05:51:09 user nova-compute[74903]:     <hostdev supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='mode'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>subsystem</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='startupPolicy'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>default</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>mandatory</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>requisite</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>optional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='subsysType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>usb</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>pci</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>scsi</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='capsType'/>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='pciBackend'/>
Nov 06 05:51:09 user nova-compute[74903]:     </hostdev>
Nov 06 05:51:09 user nova-compute[74903]:     <rng supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtio-non-transitional</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>random</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>egd</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>builtin</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </rng>
Nov 06 05:51:09 user nova-compute[74903]:     <filesystem supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='driverType'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>path</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>handle</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>virtiofs</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </filesystem>
Nov 06 05:51:09 user nova-compute[74903]:     <tpm supported='yes'>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='model'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-tis</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>tpm-crb</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:       <enum name='backendModel'>
Nov 06 05:51:09 user nova-compute[74903]:         <value>passthrough</value>
Nov 06 05:51:09 user nova-compute[74903]:         <value>emulator</value>
Nov 06 05:51:09 user nova-compute[74903]:       </enum>
Nov 06 05:51:09 user nova-compute[74903]:     </tpm>
Nov 06 05:51:09 user nova-compute[74903]:   </devices>
Nov 06 05:51:09 user nova-compute[74903]:   <features>
Nov 06 05:51:09 user nova-compute[74903]:     <gic supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:     <vmcoreinfo supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <genid supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backingStoreInput supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <backup supported='yes'/>
Nov 06 05:51:09 user nova-compute[74903]:     <sev supported='no'/>
Nov 06 05:51:09 user nova-compute[74903]:   </features>
Nov 06 05:51:09 user nova-compute[74903]: </domainCapabilities>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74903) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74903) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Checking secure boot support for host arch (x86_64) {{(pid=74903) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 05:51:09 user nova-compute[74903]: INFO nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Secure Boot support detected
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] cpu compare xml: <cpu match="exact">
Nov 06 05:51:09 user nova-compute[74903]:   <model>Nehalem</model>
Nov 06 05:51:09 user nova-compute[74903]: </cpu>
Nov 06 05:51:09 user nova-compute[74903]:  {{(pid=74903) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 06 05:51:09 user nova-compute[74903]: INFO nova.virt.node [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Generated node identity ff4fb787-d54c-4cc6-9e4b-13f1ebe11772
Nov 06 05:51:09 user nova-compute[74903]: INFO nova.virt.node [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Wrote node identity ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 to /opt/stack/data/nova/compute_id
Nov 06 05:51:09 user nova-compute[74903]: WARNING nova.compute.manager [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Compute nodes ['ff4fb787-d54c-4cc6-9e4b-13f1ebe11772'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 06 05:51:09 user nova-compute[74903]: INFO nova.compute.manager [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 06 05:51:09 user nova-compute[74903]: WARNING nova.compute.manager [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 05:51:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:51:09 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:51:10 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:51:10 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Hypervisor/Node resource view: name=user free_ram=10955MB free_disk=26.249935150146484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:51:10 user nova-compute[74903]: WARNING nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] No compute node record for user:ff4fb787-d54c-4cc6-9e4b-13f1ebe11772: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 could not be found.
Nov 06 05:51:10 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Compute node record created for user:user with uuid: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:51:10 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] [req-dc76540a-010b-43bd-b494-bfe518dd3175] Created resource provider record via placement API for resource provider with UUID ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 and name user.
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74903) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 06 05:51:10 user nova-compute[74903]: INFO nova.virt.libvirt.host [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] kernel doesn't support AMD SEV
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Libvirt baseline CPU <cpu>
Nov 06 05:51:10 user nova-compute[74903]:   <arch>x86_64</arch>
Nov 06 05:51:10 user nova-compute[74903]:   <model>Nehalem</model>
Nov 06 05:51:10 user nova-compute[74903]:   <vendor>Intel</vendor>
Nov 06 05:51:10 user nova-compute[74903]:   <topology sockets="6" cores="1" threads="1"/>
Nov 06 05:51:10 user nova-compute[74903]: </cpu>
Nov 06 05:51:10 user nova-compute[74903]:  {{(pid=74903) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Updated inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Updating resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 generation from 0 to 1 during operation: update_inventory {{(pid=74903) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Updating resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 generation from 1 to 2 during operation: update_traits {{(pid=74903) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.service [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Creating RPC server for service compute {{(pid=74903) start /opt/stack/nova/nova/service.py:182}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.service [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] Join ServiceGroup membership for this service compute {{(pid=74903) start /opt/stack/nova/nova/service.py:199}}
Nov 06 05:51:10 user nova-compute[74903]: DEBUG nova.servicegroup.drivers.db [None req-18d961eb-323b-4e42-aea5-0294171738fc None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74903) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 06 05:51:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:51:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:52:01 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:52:01 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=10388MB free_disk=26.15374755859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:52:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:53:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:53:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:53:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=26.217472076416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:53:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:53:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:53:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:54:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:54:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=10336MB free_disk=25.97156524658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:54:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:54:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:54:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:55:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=9582MB free_disk=25.999454498291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:55:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 05:55:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:55:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:09 user nova-compute[74903]: INFO nova.compute.claims [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Claim successful on node user
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.238s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:09 user nova-compute[74903]: INFO nova.compute.claims [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Claim successful on node user
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.197s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.compute.claims [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Claim successful on node user
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Creating image(s)
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "/opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.policy [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccd7e52315424aaea03ff0c931cbeec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30951113bf204ff48659ef6726d35d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.784s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.compute.claims [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Claim successful on node user
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Creating image(s)
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "/opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "/opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "/opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.policy [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d10322732ce4e93b049be06ad946cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af82cdc03f0241bb8de82b8fb9d7a66c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.virt.images [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] e8f85acc-7dce-4172-bf4e-a640a545c91b was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.part /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Creating image(s)
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "/opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "/opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.policy [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d8303851d874444b6007b48d120b1ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453949ee6d354d8dafac951e23a1b9aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.211s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:11 user nova-compute[74903]: INFO nova.compute.claims [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Claim successful on node user
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.part /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.converted" returned: 0 in 0.257s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:11 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_tznprgi/privsep.sock']
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.983s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.319s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:11 user sudo[84388]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_tznprgi/privsep.sock
Nov 06 05:55:11 user sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Creating image(s)
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.policy [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a651fca6654461c81036f79a46892ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8cbdaee9b7f4323a120240fef7ea443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Creating image(s)
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.policy [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a651fca6654461c81036f79a46892ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8cbdaee9b7f4323a120240fef7ea443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Successfully created port: c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:13 user sudo[84388]: pam_unix(sudo:session): session closed for user root
Nov 06 05:55:13 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Spawned new privsep daemon via rootwrap
Nov 06 05:55:13 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 05:55:13 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 05:55:13 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 05:55:13 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84394
Nov 06 05:55:13 user nova-compute[74903]: WARNING oslo_privsep.priv_context [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] privsep daemon already running
Nov 06 05:55:13 user nova-compute[74903]: WARNING oslo_privsep.priv_context [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] privsep daemon already running
Nov 06 05:55:13 user nova-compute[74903]: WARNING oslo_privsep.priv_context [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] privsep daemon already running
Nov 06 05:55:13 user nova-compute[74903]: WARNING oslo_privsep.priv_context [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] privsep daemon already running
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Successfully created port: fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.161s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk 1073741824" returned: 0 in 0.063s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.248s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Successfully created port: aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.167s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk 1073741824" returned: 0 in 0.045s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.524s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Cannot resize image /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Ensure instance console log exists: /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.218s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk 1073741824" returned: 0 in 0.053s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.813s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Cannot resize image /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Ensure instance console log exists: /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Successfully created port: f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk 1073741824" returned: 0 in 0.065s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Successfully created port: 82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.133s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Cannot resize image /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Ensure instance console log exists: /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.286s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk 1073741824" returned: 0 in 0.042s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Cannot resize image /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Ensure instance console log exists: /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:15 user nova-compute[74903]: INFO nova.compute.claims [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Claim successful on node user
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Successfully updated port: c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.166s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquired lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Cannot resize image /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Ensure instance console log exists: /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-changed-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Refreshing instance network info cache due to event network-changed-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] Acquiring lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Creating image(s)
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "/opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.policy [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44c3df905516436e8a6c39e0f32a2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b574412f0d4156a9d4538b17b2c163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Releasing lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Instance network_info: |[{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] Acquired lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Refreshing network info cache for port c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Start _get_guest_xml network_info=[{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk 1073741824" returned: 0 in 0.043s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2094575578',display_name='tempest-ServersNegativeTestJSON-server-2094575578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2094575578',id=2,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-giw65wo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:11Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=62b2e140-f082-47b9-8347-25ad5123e39e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lazy-loading 'pci_devices' on Instance uuid 62b2e140-f082-47b9-8347-25ad5123e39e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:16 user nova-compute[74903]:   <uuid>62b2e140-f082-47b9-8347-25ad5123e39e</uuid>
Nov 06 05:55:16 user nova-compute[74903]:   <name>instance-00000002</name>
Nov 06 05:55:16 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:16 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:16 user nova-compute[74903]:   <metadata>
Nov 06 05:55:16 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:16 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:name>tempest-ServersNegativeTestJSON-server-2094575578</nova:name>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:16</nova:creationTime>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:16 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:16 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:user uuid="ccd7e52315424aaea03ff0c931cbeec8">tempest-ServersNegativeTestJSON-668548580-project-member</nova:user>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:project uuid="30951113bf204ff48659ef6726d35d25">tempest-ServersNegativeTestJSON-668548580</nova:project>
Nov 06 05:55:16 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:16 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:16 user nova-compute[74903]:         <nova:port uuid="c3b0d19b-3612-4f71-8bd9-9fee1e553ad7">
Nov 06 05:55:16 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 05:55:16 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:16 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:16 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:16 user nova-compute[74903]:   </metadata>
Nov 06 05:55:16 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:16 user nova-compute[74903]:     <system>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="serial">62b2e140-f082-47b9-8347-25ad5123e39e</entry>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="uuid">62b2e140-f082-47b9-8347-25ad5123e39e</entry>
Nov 06 05:55:16 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:16 user nova-compute[74903]:     </system>
Nov 06 05:55:16 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:16 user nova-compute[74903]:   <os>
Nov 06 05:55:16 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:16 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:16 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:16 user nova-compute[74903]:   </os>
Nov 06 05:55:16 user nova-compute[74903]:   <features>
Nov 06 05:55:16 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:16 user nova-compute[74903]:     <apic/>
Nov 06 05:55:16 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:16 user nova-compute[74903]:   </features>
Nov 06 05:55:16 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:16 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:16 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:16 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:16 user nova-compute[74903]:   </clock>
Nov 06 05:55:16 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:16 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:16 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:16 user nova-compute[74903]:   </cpu>
Nov 06 05:55:16 user nova-compute[74903]:   <devices>
Nov 06 05:55:16 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:16 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:16 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk"/>
Nov 06 05:55:16 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:16 user nova-compute[74903]:     </disk>
Nov 06 05:55:16 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:16 user nova-compute[74903]:       <mac address="fa:16:3e:ac:bd:63"/>
Nov 06 05:55:16 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:16 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:16 user nova-compute[74903]:       <target dev="tapc3b0d19b-36"/>
Nov 06 05:55:16 user nova-compute[74903]:     </interface>
Nov 06 05:55:16 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:16 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/console.log" append="off"/>
Nov 06 05:55:16 user nova-compute[74903]:     </serial>
Nov 06 05:55:16 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:16 user nova-compute[74903]:     <video>
Nov 06 05:55:16 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:16 user nova-compute[74903]:     </video>
Nov 06 05:55:16 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:16 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:16 user nova-compute[74903]:     </rng>
Nov 06 05:55:16 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:16 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:16 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:16 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:16 user nova-compute[74903]:   </devices>
Nov 06 05:55:16 user nova-compute[74903]: </domain>
Nov 06 05:55:16 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2094575578',display_name='tempest-ServersNegativeTestJSON-server-2094575578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2094575578',id=2,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-giw65wo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:11Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=62b2e140-f082-47b9-8347-25ad5123e39e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG os_vif [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Created schema index Interface.name {{(pid=74903) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Created schema index Port.name {{(pid=74903) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Created schema index Bridge.name {{(pid=74903) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [POLLOUT] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Successfully updated port: fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.290s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bd30cd3-4a7b-5ea5-b703-05d8877f5e47', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:17 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_9h0smdt/privsep.sock']
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Successfully updated port: aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:17 user sudo[84492]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_9h0smdt/privsep.sock
Nov 06 05:55:17 user sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquired lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Cannot resize image /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Ensure instance console log exists: /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-changed-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Refreshing instance network info cache due to event network-changed-fbb94c84-40ce-49b3-8206-aa5e3619a63b. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] Acquiring lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Successfully updated port: f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Successfully updated port: 82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-changed-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Refreshing instance network info cache due to event network-changed-82f5f3d5-a09c-4e30-a784-c9bab97400ab. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:18 user sudo[84492]: pam_unix(sudo:session): session closed for user root
Nov 06 05:55:18 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Spawned new privsep daemon via rootwrap
Nov 06 05:55:18 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 05:55:18 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 05:55:18 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 06 05:55:18 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84497
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updated VIF entry in instance network info cache for port c3b0d19b-3612-4f71-8bd9-9fee1e553ad7. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-410fc7c4-3b09-439c-8577-b57bc28db2b6 req-acd3afa4-1591-4e76-b4af-6ca02a1746a2 service nova] Releasing lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Instance network_info: |[{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] Acquired lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Refreshing network info cache for port fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Start _get_guest_xml network_info=[{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Updating instance_info_cache with network_info: [{"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312529727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312529727',id=1,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-gnvfnb4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:10Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=127b0dcc-cddc-41a1-b66f-42b1eee09849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Releasing lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Instance network_info: |[{"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:18 user nova-compute[74903]:   <uuid>127b0dcc-cddc-41a1-b66f-42b1eee09849</uuid>
Nov 06 05:55:18 user nova-compute[74903]:   <name>instance-00000001</name>
Nov 06 05:55:18 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:18 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:18 user nova-compute[74903]:   <metadata>
Nov 06 05:55:18 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:18 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1312529727</nova:name>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:18</nova:creationTime>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:18 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:port uuid="fbb94c84-40ce-49b3-8206-aa5e3619a63b">
Nov 06 05:55:18 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 05:55:18 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:18 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:18 user nova-compute[74903]:   </metadata>
Nov 06 05:55:18 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:18 user nova-compute[74903]:     <system>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="serial">127b0dcc-cddc-41a1-b66f-42b1eee09849</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="uuid">127b0dcc-cddc-41a1-b66f-42b1eee09849</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:18 user nova-compute[74903]:     </system>
Nov 06 05:55:18 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:18 user nova-compute[74903]:   <os>
Nov 06 05:55:18 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:18 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:18 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:18 user nova-compute[74903]:   </os>
Nov 06 05:55:18 user nova-compute[74903]:   <features>
Nov 06 05:55:18 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:18 user nova-compute[74903]:     <apic/>
Nov 06 05:55:18 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:18 user nova-compute[74903]:   </features>
Nov 06 05:55:18 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:18 user nova-compute[74903]:   </clock>
Nov 06 05:55:18 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:18 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:18 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:18 user nova-compute[74903]:   </cpu>
Nov 06 05:55:18 user nova-compute[74903]:   <devices>
Nov 06 05:55:18 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:18 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:18 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk"/>
Nov 06 05:55:18 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:     </disk>
Nov 06 05:55:18 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:18 user nova-compute[74903]:       <mac address="fa:16:3e:df:31:bf"/>
Nov 06 05:55:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:18 user nova-compute[74903]:       <target dev="tapfbb94c84-40"/>
Nov 06 05:55:18 user nova-compute[74903]:     </interface>
Nov 06 05:55:18 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:18 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/console.log" append="off"/>
Nov 06 05:55:18 user nova-compute[74903]:     </serial>
Nov 06 05:55:18 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:18 user nova-compute[74903]:     <video>
Nov 06 05:55:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:     </video>
Nov 06 05:55:18 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:18 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:18 user nova-compute[74903]:     </rng>
Nov 06 05:55:18 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:18 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:18 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:18 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:18 user nova-compute[74903]:   </devices>
Nov 06 05:55:18 user nova-compute[74903]: </domain>
Nov 06 05:55:18 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312529727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312529727',id=1,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-gnvfnb4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:10Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=127b0dcc-cddc-41a1-b66f-42b1eee09849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG os_vif [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Start _get_guest_xml network_info=[{"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ec90879-cdd5-5bbd-8116-3ddee3a607d7', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1294840264',display_name='tempest-DeleteServersTestJSON-server-1294840264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1294840264',id=4,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453949ee6d354d8dafac951e23a1b9aa',ramdisk_id='',reservation_id='r-jnyaqgdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1225512574',owner_user_name='tempest-DeleteServersTestJSON-1225512574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:11Z,user_data=None,user_id='9d8303851d874444b6007b48d120b1ec',uuid=dd9243d7-a43b-46d4-a669-ab1ff5460a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converting VIF {"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lazy-loading 'pci_devices' on Instance uuid dd9243d7-a43b-46d4-a669-ab1ff5460a7c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:18 user nova-compute[74903]:   <uuid>dd9243d7-a43b-46d4-a669-ab1ff5460a7c</uuid>
Nov 06 05:55:18 user nova-compute[74903]:   <name>instance-00000004</name>
Nov 06 05:55:18 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:18 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:18 user nova-compute[74903]:   <metadata>
Nov 06 05:55:18 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:18 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:name>tempest-DeleteServersTestJSON-server-1294840264</nova:name>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:18</nova:creationTime>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:18 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:user uuid="9d8303851d874444b6007b48d120b1ec">tempest-DeleteServersTestJSON-1225512574-project-member</nova:user>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:project uuid="453949ee6d354d8dafac951e23a1b9aa">tempest-DeleteServersTestJSON-1225512574</nova:project>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:18 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:18 user nova-compute[74903]:         <nova:port uuid="aa4c4a90-9a55-4cd3-804d-e10c2a07773c">
Nov 06 05:55:18 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 05:55:18 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:18 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:18 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:18 user nova-compute[74903]:   </metadata>
Nov 06 05:55:18 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:18 user nova-compute[74903]:     <system>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="serial">dd9243d7-a43b-46d4-a669-ab1ff5460a7c</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="uuid">dd9243d7-a43b-46d4-a669-ab1ff5460a7c</entry>
Nov 06 05:55:18 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:18 user nova-compute[74903]:     </system>
Nov 06 05:55:18 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:18 user nova-compute[74903]:   <os>
Nov 06 05:55:18 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:18 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:18 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:18 user nova-compute[74903]:   </os>
Nov 06 05:55:18 user nova-compute[74903]:   <features>
Nov 06 05:55:18 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:18 user nova-compute[74903]:     <apic/>
Nov 06 05:55:18 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:18 user nova-compute[74903]:   </features>
Nov 06 05:55:18 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:18 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:18 user nova-compute[74903]:   </clock>
Nov 06 05:55:18 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:18 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:18 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:18 user nova-compute[74903]:   </cpu>
Nov 06 05:55:18 user nova-compute[74903]:   <devices>
Nov 06 05:55:18 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:18 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:18 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk"/>
Nov 06 05:55:18 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:     </disk>
Nov 06 05:55:18 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:18 user nova-compute[74903]:       <mac address="fa:16:3e:a2:90:4b"/>
Nov 06 05:55:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:18 user nova-compute[74903]:       <target dev="tapaa4c4a90-9a"/>
Nov 06 05:55:18 user nova-compute[74903]:     </interface>
Nov 06 05:55:18 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:18 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/console.log" append="off"/>
Nov 06 05:55:18 user nova-compute[74903]:     </serial>
Nov 06 05:55:18 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:18 user nova-compute[74903]:     <video>
Nov 06 05:55:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:18 user nova-compute[74903]:     </video>
Nov 06 05:55:18 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:18 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:18 user nova-compute[74903]:     </rng>
Nov 06 05:55:18 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:18 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:18 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:18 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:18 user nova-compute[74903]:   </devices>
Nov 06 05:55:18 user nova-compute[74903]: </domain>
Nov 06 05:55:18 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1294840264',display_name='tempest-DeleteServersTestJSON-server-1294840264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1294840264',id=4,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453949ee6d354d8dafac951e23a1b9aa',ramdisk_id='',reservation_id='r-jnyaqgdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1225512574',owner_user_name='tempest-DeleteServersTestJSON-1225512574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:11Z,user_data=None,user_id='9d8303851d874444b6007b48d120b1ec',uuid=dd9243d7-a43b-46d4-a669-ab1ff5460a7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converting VIF {"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG os_vif [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1b4173a-7eaf-57c8-a790-9be23bc55166', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa4c4a90-9a, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa4c4a90-9a, col_values=(('qos', UUID('8729fb5f-1587-4f28-b7d8-4405978c9a01')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa4c4a90-9a, col_values=(('external_ids', {'iface-id': 'aa4c4a90-9a55-4cd3-804d-e10c2a07773c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:90:4b', 'vm-uuid': 'dd9243d7-a43b-46d4-a669-ab1ff5460a7c'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: INFO os_vif [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a')
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbb94c84-40, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbb94c84-40, col_values=(('qos', UUID('b744f700-660b-4191-a75c-ebb00ef47415')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbb94c84-40, col_values=(('external_ids', {'iface-id': 'fbb94c84-40ce-49b3-8206-aa5e3619a63b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:31:bf', 'vm-uuid': '127b0dcc-cddc-41a1-b66f-42b1eee09849'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: INFO os_vif [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40')
Nov 06 05:55:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance network_info: |[{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3b0d19b-36, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3b0d19b-36, col_values=(('qos', UUID('9841d438-5574-4cf0-9d98-f98e87be0618')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3b0d19b-36, col_values=(('external_ids', {'iface-id': 'c3b0d19b-3612-4f71-8bd9-9fee1e553ad7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:bd:63', 'vm-uuid': '62b2e140-f082-47b9-8347-25ad5123e39e'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Successfully created port: 2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start _get_guest_xml network_info=[{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:18 user nova-compute[74903]: INFO os_vif [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36')
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] No VIF found with MAC fa:16:3e:a2:90:4b, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-707951993',display_name='tempest-ServerRescueNegativeTestJSON-server-707951993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-707951993',id=5,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-rbt5057z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:12Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=f023ad69-b053-4fae-a05a-dc66bbd76bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:19 user nova-compute[74903]:   <uuid>f023ad69-b053-4fae-a05a-dc66bbd76bfc</uuid>
Nov 06 05:55:19 user nova-compute[74903]:   <name>instance-00000005</name>
Nov 06 05:55:19 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:19 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:19 user nova-compute[74903]:   <metadata>
Nov 06 05:55:19 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:19 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-707951993</nova:name>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:19</nova:creationTime>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:19 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:port uuid="f2fa5c41-e062-4b4a-aaa2-95dcad72c58f">
Nov 06 05:55:19 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 05:55:19 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:19 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:19 user nova-compute[74903]:   </metadata>
Nov 06 05:55:19 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:19 user nova-compute[74903]:     <system>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="serial">f023ad69-b053-4fae-a05a-dc66bbd76bfc</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="uuid">f023ad69-b053-4fae-a05a-dc66bbd76bfc</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:19 user nova-compute[74903]:     </system>
Nov 06 05:55:19 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:19 user nova-compute[74903]:   <os>
Nov 06 05:55:19 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:19 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:19 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:19 user nova-compute[74903]:   </os>
Nov 06 05:55:19 user nova-compute[74903]:   <features>
Nov 06 05:55:19 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:19 user nova-compute[74903]:     <apic/>
Nov 06 05:55:19 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:19 user nova-compute[74903]:   </features>
Nov 06 05:55:19 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:19 user nova-compute[74903]:   </clock>
Nov 06 05:55:19 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:19 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:19 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:19 user nova-compute[74903]:   </cpu>
Nov 06 05:55:19 user nova-compute[74903]:   <devices>
Nov 06 05:55:19 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:19 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:19 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk"/>
Nov 06 05:55:19 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:     </disk>
Nov 06 05:55:19 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:19 user nova-compute[74903]:       <mac address="fa:16:3e:70:d6:fd"/>
Nov 06 05:55:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:19 user nova-compute[74903]:       <target dev="tapf2fa5c41-e0"/>
Nov 06 05:55:19 user nova-compute[74903]:     </interface>
Nov 06 05:55:19 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:19 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/console.log" append="off"/>
Nov 06 05:55:19 user nova-compute[74903]:     </serial>
Nov 06 05:55:19 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:19 user nova-compute[74903]:     <video>
Nov 06 05:55:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:     </video>
Nov 06 05:55:19 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:19 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:19 user nova-compute[74903]:     </rng>
Nov 06 05:55:19 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:19 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:19 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:19 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:19 user nova-compute[74903]:   </devices>
Nov 06 05:55:19 user nova-compute[74903]: </domain>
Nov 06 05:55:19 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-707951993',display_name='tempest-ServerRescueNegativeTestJSON-server-707951993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-707951993',id=5,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-rbt5057z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:12Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=f023ad69-b053-4fae-a05a-dc66bbd76bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG os_vif [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a10d85df-5139-5e53-adb4-d438dfde8e5c', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:df:31:bf, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] No VIF found with MAC fa:16:3e:ac:bd:63, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance network_info: |[{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Refreshing network info cache for port 82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start _get_guest_xml network_info=[{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1277920532',display_name='tempest-ServerRescueNegativeTestJSON-server-1277920532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1277920532',id=3,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-5ylx3b5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:12Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=62b95f70-d2ef-4b37-9e0f-2fa8477642de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:19 user nova-compute[74903]:   <uuid>62b95f70-d2ef-4b37-9e0f-2fa8477642de</uuid>
Nov 06 05:55:19 user nova-compute[74903]:   <name>instance-00000003</name>
Nov 06 05:55:19 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:19 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:19 user nova-compute[74903]:   <metadata>
Nov 06 05:55:19 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:19 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1277920532</nova:name>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:19</nova:creationTime>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:19 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:19 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:19 user nova-compute[74903]:         <nova:port uuid="82f5f3d5-a09c-4e30-a784-c9bab97400ab">
Nov 06 05:55:19 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 05:55:19 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:19 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:19 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:19 user nova-compute[74903]:   </metadata>
Nov 06 05:55:19 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:19 user nova-compute[74903]:     <system>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="serial">62b95f70-d2ef-4b37-9e0f-2fa8477642de</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="uuid">62b95f70-d2ef-4b37-9e0f-2fa8477642de</entry>
Nov 06 05:55:19 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:19 user nova-compute[74903]:     </system>
Nov 06 05:55:19 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:19 user nova-compute[74903]:   <os>
Nov 06 05:55:19 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:19 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:19 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:19 user nova-compute[74903]:   </os>
Nov 06 05:55:19 user nova-compute[74903]:   <features>
Nov 06 05:55:19 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:19 user nova-compute[74903]:     <apic/>
Nov 06 05:55:19 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:19 user nova-compute[74903]:   </features>
Nov 06 05:55:19 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:19 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:19 user nova-compute[74903]:   </clock>
Nov 06 05:55:19 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:19 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:19 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:19 user nova-compute[74903]:   </cpu>
Nov 06 05:55:19 user nova-compute[74903]:   <devices>
Nov 06 05:55:19 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:19 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:19 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk"/>
Nov 06 05:55:19 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:     </disk>
Nov 06 05:55:19 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:19 user nova-compute[74903]:       <mac address="fa:16:3e:6c:4c:c1"/>
Nov 06 05:55:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:19 user nova-compute[74903]:       <target dev="tap82f5f3d5-a0"/>
Nov 06 05:55:19 user nova-compute[74903]:     </interface>
Nov 06 05:55:19 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:19 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/console.log" append="off"/>
Nov 06 05:55:19 user nova-compute[74903]:     </serial>
Nov 06 05:55:19 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:19 user nova-compute[74903]:     <video>
Nov 06 05:55:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:19 user nova-compute[74903]:     </video>
Nov 06 05:55:19 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:19 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:19 user nova-compute[74903]:     </rng>
Nov 06 05:55:19 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:19 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:19 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:19 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:19 user nova-compute[74903]:   </devices>
Nov 06 05:55:19 user nova-compute[74903]: </domain>
Nov 06 05:55:19 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1277920532',display_name='tempest-ServerRescueNegativeTestJSON-server-1277920532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1277920532',id=3,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-5ylx3b5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:12Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=62b95f70-d2ef-4b37-9e0f-2fa8477642de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG os_vif [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2fa5c41-e0, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2fa5c41-e0, col_values=(('qos', UUID('99ff1810-f06e-41e1-a926-24d237db29f0')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2fa5c41-e0, col_values=(('external_ids', {'iface-id': 'f2fa5c41-e062-4b4a-aaa2-95dcad72c58f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:d6:fd', 'vm-uuid': 'f023ad69-b053-4fae-a05a-dc66bbd76bfc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-changed-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Refreshing instance network info cache due to event network-changed-aa4c4a90-9a55-4cd3-804d-e10c2a07773c. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Acquiring lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Acquired lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Refreshing network info cache for port aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: INFO os_vif [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0')
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7025cab6-05dd-5b3a-83c5-9fe43bc1830a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82f5f3d5-a0, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82f5f3d5-a0, col_values=(('qos', UUID('5d310bf6-1d7c-43a9-99e9-c0b7f7992592')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82f5f3d5-a0, col_values=(('external_ids', {'iface-id': '82f5f3d5-a09c-4e30-a784-c9bab97400ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:4c:c1', 'vm-uuid': '62b95f70-d2ef-4b37-9e0f-2fa8477642de'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:70:d6:fd, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:19 user nova-compute[74903]: INFO os_vif [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0')
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:6c:4c:c1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updated VIF entry in instance network info cache for port fbb94c84-40ce-49b3-8206-aa5e3619a63b. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc84b2dc-30a8-4aa6-bd44-2cf70c1c5f81 req-140f436b-4cf6-46d1-9ae2-b65f07ade607 service nova] Releasing lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updated VIF entry in instance network info cache for port 82f5f3d5-a09c-4e30-a784-c9bab97400ab. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1e0e84ca-d554-4382-b185-4dae66e2932e req-9fb7b4f6-44a2-4dd4-abeb-abc4d2c7984e service nova] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Updated VIF entry in instance network info cache for port aa4c4a90-9a55-4cd3-804d-e10c2a07773c. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Updating instance_info_cache with network_info: [{"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Releasing lock "refresh_cache-dd9243d7-a43b-46d4-a669-ab1ff5460a7c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-changed-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Refreshing instance network info cache due to event network-changed-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Refreshing network info cache for port f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Successfully updated port: 2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updated VIF entry in instance network info cache for port f2fa5c41-e062-4b4a-aaa2-95dcad72c58f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4cbd7d8b-b64c-40ba-bd96-b035151ecb4d req-4366a20b-9772-4f0a-8e45-b05b2605e143 service nova] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing instance network info cache due to event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Instance network_info: |[{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Start _get_guest_xml network_info=[{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated VIF entry in instance network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ea55f49f-2c5b-4df2-a73a-e33a9d192cf8 req-bca58960-b312-40f8-b7da-434c632df1c1 service nova] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Instance spawned successfully.
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-722628018',display_name='tempest-ServerActionsTestOtherA-server-722628018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-722628018',id=6,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-61wuii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=00426b5a-c105-48da-ab5f-82f04a4dd090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'pci_devices' on Instance uuid 00426b5a-c105-48da-ab5f-82f04a4dd090 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:28 user nova-compute[74903]:   <uuid>00426b5a-c105-48da-ab5f-82f04a4dd090</uuid>
Nov 06 05:55:28 user nova-compute[74903]:   <name>instance-00000006</name>
Nov 06 05:55:28 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:28 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:28 user nova-compute[74903]:   <metadata>
Nov 06 05:55:28 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:28 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherA-server-722628018</nova:name>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:28</nova:creationTime>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:28 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:28 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:user uuid="44c3df905516436e8a6c39e0f32a2e4b">tempest-ServerActionsTestOtherA-851074598-project-member</nova:user>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:project uuid="29b574412f0d4156a9d4538b17b2c163">tempest-ServerActionsTestOtherA-851074598</nova:project>
Nov 06 05:55:28 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:28 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:28 user nova-compute[74903]:         <nova:port uuid="2dbd1bff-f466-401e-919d-ef5a28920fe3">
Nov 06 05:55:28 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 05:55:28 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:28 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:28 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:28 user nova-compute[74903]:   </metadata>
Nov 06 05:55:28 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:28 user nova-compute[74903]:     <system>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="serial">00426b5a-c105-48da-ab5f-82f04a4dd090</entry>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="uuid">00426b5a-c105-48da-ab5f-82f04a4dd090</entry>
Nov 06 05:55:28 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:28 user nova-compute[74903]:     </system>
Nov 06 05:55:28 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:28 user nova-compute[74903]:   <os>
Nov 06 05:55:28 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:28 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:28 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:28 user nova-compute[74903]:   </os>
Nov 06 05:55:28 user nova-compute[74903]:   <features>
Nov 06 05:55:28 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:28 user nova-compute[74903]:     <apic/>
Nov 06 05:55:28 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:28 user nova-compute[74903]:   </features>
Nov 06 05:55:28 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:28 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:28 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:28 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:28 user nova-compute[74903]:   </clock>
Nov 06 05:55:28 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:28 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:28 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:28 user nova-compute[74903]:   </cpu>
Nov 06 05:55:28 user nova-compute[74903]:   <devices>
Nov 06 05:55:28 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:28 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:28 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk"/>
Nov 06 05:55:28 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:28 user nova-compute[74903]:     </disk>
Nov 06 05:55:28 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:28 user nova-compute[74903]:       <mac address="fa:16:3e:50:16:c5"/>
Nov 06 05:55:28 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:28 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:28 user nova-compute[74903]:       <target dev="tap2dbd1bff-f4"/>
Nov 06 05:55:28 user nova-compute[74903]:     </interface>
Nov 06 05:55:28 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:28 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/console.log" append="off"/>
Nov 06 05:55:28 user nova-compute[74903]:     </serial>
Nov 06 05:55:28 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:28 user nova-compute[74903]:     <video>
Nov 06 05:55:28 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:28 user nova-compute[74903]:     </video>
Nov 06 05:55:28 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:28 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:28 user nova-compute[74903]:     </rng>
Nov 06 05:55:28 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:28 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:28 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:28 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:28 user nova-compute[74903]:   </devices>
Nov 06 05:55:28 user nova-compute[74903]: </domain>
Nov 06 05:55:28 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-722628018',display_name='tempest-ServerActionsTestOtherA-server-722628018',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-722628018',id=6,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-61wuii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=00426b5a-c105-48da-ab5f-82f04a4dd090,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG os_vif [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5560b80-90d3-5704-8400-839225fe99d0', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dbd1bff-f4, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dbd1bff-f4, col_values=(('qos', UUID('eae42f9d-187f-4eef-927d-6a60a8dcac90')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dbd1bff-f4, col_values=(('external_ids', {'iface-id': '2dbd1bff-f466-401e-919d-ef5a28920fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:16:c5', 'vm-uuid': '00426b5a-c105-48da-ab5f-82f04a4dd090'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:28 user nova-compute[74903]: INFO nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Took 16.86 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:28 user nova-compute[74903]: INFO os_vif [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4')
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:50:16:c5, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:28 user nova-compute[74903]: INFO nova.compute.manager [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Took 18.73 seconds to build instance.
Nov 06 05:55:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-34f41ef2-abb5-4b43-9721-a1b9ccd59c98 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.909s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Instance spawned successfully.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance spawned successfully.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance spawned successfully.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Took 18.30 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Instance spawned successfully.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Took 17.37 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Took 19.95 seconds to build instance.
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Took 16.87 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b89e4891-6aac-4d2e-b742-9d533579345b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.224s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Took 19.28 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Took 19.46 seconds to build instance.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-80fabc15-ba70-4531-9924-bf117f57e557 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.747s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Took 18.23 seconds to build instance.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-139f496a-5e64-4acb-b4b5-23324636aa84 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.396s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:29 user nova-compute[74903]: INFO nova.compute.manager [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Took 20.87 seconds to build instance.
Nov 06 05:55:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7c1625b0-a56e-4b88-b0ac-2170acb920f4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.167s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] No waiting events found dispatching network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:30 user nova-compute[74903]: WARNING nova.compute.manager [req-b43ca4f9-d259-4bbd-a1c0-96b560504095 req-88829095-299a-4bce-8cb3-f897be2232ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received unexpected event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c for instance with vm_state active and task_state None.
Nov 06 05:55:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] No waiting events found dispatching network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:32 user nova-compute[74903]: WARNING nova.compute.manager [req-7d5cf9c6-054b-4ff0-8702-ba48d0695381 req-3715dc9a-4246-4f8b-8680-1f0beb5e7a47 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received unexpected event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c for instance with vm_state active and task_state None.
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Instance spawned successfully.
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:33 user nova-compute[74903]: INFO nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Took 17.60 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:33 user nova-compute[74903]: INFO nova.compute.manager [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Took 18.81 seconds to build instance.
Nov 06 05:55:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a3ea72db-6284-41e2-b74e-780a248eccd2 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.048s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:35 user nova-compute[74903]: INFO nova.compute.claims [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Claim successful on node user
Nov 06 05:55:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.910s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.policy [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8990e94a694448a7bd21663308e81e36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f23457df2a4f07911c88a4d6bf2f02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Creating image(s)
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.part --force-share --output=json" returned: 0 in 0.403s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG nova.virt.images [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] 94c412da-9ff7-4321-9bcc-c3d85234cb4a was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 05:55:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.part /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.part /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.converted" returned: 0 in 0.299s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Successfully created port: 98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5.converted --force-share --output=json" returned: 0 in 0.293s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.556s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json" returned: 0 in 0.232s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json" returned: 0 in 0.266s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5,backing_fmt=raw /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5,backing_fmt=raw /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk 1073741824" returned: 0 in 0.079s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 --force-share --output=json" returned: 0 in 0.306s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Successfully updated port: 98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquired lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-changed-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Refreshing instance network info cache due to event network-changed-98b72f04-2d16-44fb-af90-ac3ba4aec556. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] Acquiring lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Cannot resize image /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Ensure instance console log exists: /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:39 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating instance_info_cache with network_info: [{"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Releasing lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Instance network_info: |[{"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] Acquired lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Refreshing network info cache for port 98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Start _get_guest_xml network_info=[{"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:55:27Z,direct_url=<?>,disk_format='qcow2',id=94c412da-9ff7-4321-9bcc-c3d85234cb4a,min_disk=0,min_ram=0,name='',owner='5225c2ac95cd4df8a149870464be4004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:55:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/sda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': '94c412da-9ff7-4321-9bcc-c3d85234cb4a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:55:27Z,direct_url=<?>,disk_format='qcow2',id=94c412da-9ff7-4321-9bcc-c3d85234cb4a,min_disk=0,min_ram=0,name='',owner='5225c2ac95cd4df8a149870464be4004',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:55:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1766771039',display_name='tempest-AttachSCSIVolumeTestJSON-server-1766771039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1766771039',id=7,image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2AOR2Tp/O5BLjibMnIln4FTdU8REBadv9vPGpIUv624yN95Xq+whMIx+XSWv+b/nXhPg2NH/I4X74NhEtsRTRw8zFUGXZsb0aC+xkNiDv56dSPUibWAhVJebT3r98NyQ==',key_name='tempest-keypair-189084297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f23457df2a4f07911c88a4d6bf2f02',ramdisk_id='',reservation_id='r-n1brltt9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1938999723',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1938999723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8990e94a694448a7bd21663308e81e36',uuid=814088c5-7ba1-4596-9a8d-8135ab4b8668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converting VIF {"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.objects.instance [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lazy-loading 'pci_devices' on Instance uuid 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:40 user nova-compute[74903]:   <uuid>814088c5-7ba1-4596-9a8d-8135ab4b8668</uuid>
Nov 06 05:55:40 user nova-compute[74903]:   <name>instance-00000007</name>
Nov 06 05:55:40 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:40 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:40 user nova-compute[74903]:   <metadata>
Nov 06 05:55:40 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:40 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1766771039</nova:name>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:40</nova:creationTime>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:40 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:40 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:user uuid="8990e94a694448a7bd21663308e81e36">tempest-AttachSCSIVolumeTestJSON-1938999723-project-member</nova:user>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:project uuid="e9f23457df2a4f07911c88a4d6bf2f02">tempest-AttachSCSIVolumeTestJSON-1938999723</nova:project>
Nov 06 05:55:40 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:root type="image" uuid="94c412da-9ff7-4321-9bcc-c3d85234cb4a"/>
Nov 06 05:55:40 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:40 user nova-compute[74903]:         <nova:port uuid="98b72f04-2d16-44fb-af90-ac3ba4aec556">
Nov 06 05:55:40 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 05:55:40 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:40 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:40 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:40 user nova-compute[74903]:   </metadata>
Nov 06 05:55:40 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:40 user nova-compute[74903]:     <system>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="serial">814088c5-7ba1-4596-9a8d-8135ab4b8668</entry>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="uuid">814088c5-7ba1-4596-9a8d-8135ab4b8668</entry>
Nov 06 05:55:40 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:40 user nova-compute[74903]:     </system>
Nov 06 05:55:40 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:40 user nova-compute[74903]:   <os>
Nov 06 05:55:40 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:40 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:40 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:40 user nova-compute[74903]:   </os>
Nov 06 05:55:40 user nova-compute[74903]:   <features>
Nov 06 05:55:40 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:40 user nova-compute[74903]:     <apic/>
Nov 06 05:55:40 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:40 user nova-compute[74903]:   </features>
Nov 06 05:55:40 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:40 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:40 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:40 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:40 user nova-compute[74903]:   </clock>
Nov 06 05:55:40 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:40 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:40 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:40 user nova-compute[74903]:   </cpu>
Nov 06 05:55:40 user nova-compute[74903]:   <devices>
Nov 06 05:55:40 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:40 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:40 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk"/>
Nov 06 05:55:40 user nova-compute[74903]:       <target dev="sda" bus="scsi"/>
Nov 06 05:55:40 user nova-compute[74903]:       <address type="drive" controller="0" unit="0"/>
Nov 06 05:55:40 user nova-compute[74903]:     </disk>
Nov 06 05:55:40 user nova-compute[74903]:     <disk type="file" device="cdrom">
Nov 06 05:55:40 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 05:55:40 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.config"/>
Nov 06 05:55:40 user nova-compute[74903]:       <target dev="sdb" bus="scsi"/>
Nov 06 05:55:40 user nova-compute[74903]:       <address type="drive" controller="0" unit="1"/>
Nov 06 05:55:40 user nova-compute[74903]:     </disk>
Nov 06 05:55:40 user nova-compute[74903]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 06 05:55:40 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:40 user nova-compute[74903]:       <mac address="fa:16:3e:9d:37:6b"/>
Nov 06 05:55:40 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:40 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:40 user nova-compute[74903]:       <target dev="tap98b72f04-2d"/>
Nov 06 05:55:40 user nova-compute[74903]:     </interface>
Nov 06 05:55:40 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:40 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/console.log" append="off"/>
Nov 06 05:55:40 user nova-compute[74903]:     </serial>
Nov 06 05:55:40 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:40 user nova-compute[74903]:     <video>
Nov 06 05:55:40 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:40 user nova-compute[74903]:     </video>
Nov 06 05:55:40 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:40 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:40 user nova-compute[74903]:     </rng>
Nov 06 05:55:40 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:40 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:40 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:40 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:40 user nova-compute[74903]:   </devices>
Nov 06 05:55:40 user nova-compute[74903]: </domain>
Nov 06 05:55:40 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1766771039',display_name='tempest-AttachSCSIVolumeTestJSON-server-1766771039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1766771039',id=7,image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2AOR2Tp/O5BLjibMnIln4FTdU8REBadv9vPGpIUv624yN95Xq+whMIx+XSWv+b/nXhPg2NH/I4X74NhEtsRTRw8zFUGXZsb0aC+xkNiDv56dSPUibWAhVJebT3r98NyQ==',key_name='tempest-keypair-189084297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9f23457df2a4f07911c88a4d6bf2f02',ramdisk_id='',reservation_id='r-n1brltt9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1938999723',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1938999723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8990e94a694448a7bd21663308e81e36',uuid=814088c5-7ba1-4596-9a8d-8135ab4b8668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converting VIF {"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG os_vif [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4ac0321-2d10-5971-96d4-351149bd1247', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98b72f04-2d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98b72f04-2d, col_values=(('qos', UUID('32b1a161-bb3d-4529-9fe9-02dfdc7fac7b')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98b72f04-2d, col_values=(('external_ids', {'iface-id': '98b72f04-2d16-44fb-af90-ac3ba4aec556', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:37:6b', 'vm-uuid': '814088c5-7ba1-4596-9a8d-8135ab4b8668'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: INFO os_vif [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d')
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No BDM found with device name sda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No VIF found with MAC fa:16:3e:9d:37:6b, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Using config drive
Nov 06 05:55:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updated VIF entry in instance network info cache for port 98b72f04-2d16-44fb-af90-ac3ba4aec556. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating instance_info_cache with network_info: [{"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fce4e9c9-04be-4e31-93c3-a36d46315b28 req-7bafc0ad-3afb-478c-9777-32b1f6ea441a service nova] Releasing lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Creating config drive at /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.config
Nov 06 05:55:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd_na1lcv {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd_na1lcv" returned: 0 in 0.059s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] No waiting events found dispatching network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:42 user nova-compute[74903]: WARNING nova.compute.manager [req-b9287fa0-0bf1-4e81-8a86-8dd01f826237 req-ef5c65aa-00b7-4b3c-910c-bdc6f8921870 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received unexpected event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 for instance with vm_state active and task_state None.
Nov 06 05:55:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] No waiting events found dispatching network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:43 user nova-compute[74903]: WARNING nova.compute.manager [req-3e67a3d6-44e3-499c-ae4d-31b497f83ea4 req-e9540a15-d2d9-41c3-9f40-6c02efeab760 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received unexpected event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 for instance with vm_state active and task_state None.
Nov 06 05:55:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] No waiting events found dispatching network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:45 user nova-compute[74903]: WARNING nova.compute.manager [req-157be707-eb5d-4db1-9060-54f0d4e1569c req-7c38d082-e56a-480b-845a-0df146568ae7 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received unexpected event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 for instance with vm_state active and task_state None.
Nov 06 05:55:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] No waiting events found dispatching network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:45 user nova-compute[74903]: WARNING nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received unexpected event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 for instance with vm_state active and task_state None.
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:45 user nova-compute[74903]: WARNING nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state building and task_state spawning.
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:45 user nova-compute[74903]: WARNING nova.compute.manager [req-0474f822-cc9c-4257-a668-f2c3bd2e3619 req-08ebe65d-ca39-4c54-bb6a-734feeebc2c0 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state building and task_state spawning.
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Instance spawned successfully.
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:46 user nova-compute[74903]: INFO nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Took 9.45 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:46 user nova-compute[74903]: DEBUG nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:46 user nova-compute[74903]: INFO nova.compute.manager [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Took 10.96 seconds to build instance.
Nov 06 05:55:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-97b519fe-1e94-41b6-899e-68f8f7f3f3d6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.352s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:47 user nova-compute[74903]: WARNING nova.compute.manager [req-812b968a-e5d8-49e4-90e0-7a7b6b834cc9 req-74def2b0-cb61-4272-8e85-7a118cd662b3 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:55:49 user nova-compute[74903]: INFO nova.compute.claims [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Claim successful on node user
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:49 user nova-compute[74903]: WARNING nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:49 user nova-compute[74903]: WARNING nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:49 user nova-compute[74903]: WARNING nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] No waiting events found dispatching network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:49 user nova-compute[74903]: WARNING nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received unexpected event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] No waiting events found dispatching network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:49 user nova-compute[74903]: WARNING nova.compute.manager [req-861a2f55-097f-4957-ade3-592e1b0a0bf8 req-f81782e4-b9c1-4161-b89c-da9c13a5dfdc service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received unexpected event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b for instance with vm_state active and task_state None.
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:55:49 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:55:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.policy [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11a56f4a67554df7b957d26655ca86af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8118c385b9a4fb18fc87412ae6d7673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:55:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Creating image(s)
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "/opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "/opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk 1073741824" returned: 0 in 0.062s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Successfully created port: 9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Cannot resize image /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Ensure instance console log exists: /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Successfully updated port: 9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquired lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-changed-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Refreshing instance network info cache due to event network-changed-9c8973d6-665a-4a19-b06a-0c18069bbf07. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] Acquiring lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:55:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.neutron [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updating instance_info_cache with network_info: [{"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Releasing lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Instance network_info: |[{"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] Acquired lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.neutron [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Refreshing network info cache for port 9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Start _get_guest_xml network_info=[{"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:55:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2049275497',display_name='tempest-VolumesAssistedSnapshotsTest-server-2049275497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2049275497',id=8,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlonfE76DqAW8aan8soNKSpWdvjiCcCJ+99uiEaJdFg7uO8jmwA0wgfElFsRzLg2wWi1sSGfD57sBdzjXqjrZk5irY4GISqa/BtmveuBVRWSmJF/am/xzZTBu5YpfF9eA==',key_name='tempest-keypair-625809800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8118c385b9a4fb18fc87412ae6d7673',ramdisk_id='',reservation_id='r-ey9dfq5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1048584358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1048584358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a56f4a67554df7b957d26655ca86af',uuid=c6a9cf35-00cf-45b9-8727-267f150024a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converting VIF {"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lazy-loading 'pci_devices' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:55:52 user nova-compute[74903]:   <uuid>c6a9cf35-00cf-45b9-8727-267f150024a9</uuid>
Nov 06 05:55:52 user nova-compute[74903]:   <name>instance-00000008</name>
Nov 06 05:55:52 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:55:52 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:55:52 user nova-compute[74903]:   <metadata>
Nov 06 05:55:52 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:55:52 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2049275497</nova:name>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:55:52</nova:creationTime>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:55:52 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:55:52 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:owner>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:user uuid="11a56f4a67554df7b957d26655ca86af">tempest-VolumesAssistedSnapshotsTest-1048584358-project-member</nova:user>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:project uuid="b8118c385b9a4fb18fc87412ae6d7673">tempest-VolumesAssistedSnapshotsTest-1048584358</nova:project>
Nov 06 05:55:52 user nova-compute[74903]:       </nova:owner>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:55:52 user nova-compute[74903]:       <nova:ports>
Nov 06 05:55:52 user nova-compute[74903]:         <nova:port uuid="9c8973d6-665a-4a19-b06a-0c18069bbf07">
Nov 06 05:55:52 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 05:55:52 user nova-compute[74903]:         </nova:port>
Nov 06 05:55:52 user nova-compute[74903]:       </nova:ports>
Nov 06 05:55:52 user nova-compute[74903]:     </nova:instance>
Nov 06 05:55:52 user nova-compute[74903]:   </metadata>
Nov 06 05:55:52 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:55:52 user nova-compute[74903]:     <system>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="serial">c6a9cf35-00cf-45b9-8727-267f150024a9</entry>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="uuid">c6a9cf35-00cf-45b9-8727-267f150024a9</entry>
Nov 06 05:55:52 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:55:52 user nova-compute[74903]:     </system>
Nov 06 05:55:52 user nova-compute[74903]:   </sysinfo>
Nov 06 05:55:52 user nova-compute[74903]:   <os>
Nov 06 05:55:52 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:55:52 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:55:52 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:55:52 user nova-compute[74903]:   </os>
Nov 06 05:55:52 user nova-compute[74903]:   <features>
Nov 06 05:55:52 user nova-compute[74903]:     <acpi/>
Nov 06 05:55:52 user nova-compute[74903]:     <apic/>
Nov 06 05:55:52 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:55:52 user nova-compute[74903]:   </features>
Nov 06 05:55:52 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:55:52 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:55:52 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:55:52 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:55:52 user nova-compute[74903]:   </clock>
Nov 06 05:55:52 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:55:52 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:55:52 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:55:52 user nova-compute[74903]:   </cpu>
Nov 06 05:55:52 user nova-compute[74903]:   <devices>
Nov 06 05:55:52 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:55:52 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:55:52 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk"/>
Nov 06 05:55:52 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:55:52 user nova-compute[74903]:     </disk>
Nov 06 05:55:52 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:55:52 user nova-compute[74903]:       <mac address="fa:16:3e:da:cc:f5"/>
Nov 06 05:55:52 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:52 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:55:52 user nova-compute[74903]:       <target dev="tap9c8973d6-66"/>
Nov 06 05:55:52 user nova-compute[74903]:     </interface>
Nov 06 05:55:52 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:55:52 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/console.log" append="off"/>
Nov 06 05:55:52 user nova-compute[74903]:     </serial>
Nov 06 05:55:52 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:55:52 user nova-compute[74903]:     <video>
Nov 06 05:55:52 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:55:52 user nova-compute[74903]:     </video>
Nov 06 05:55:52 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:55:52 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:55:52 user nova-compute[74903]:     </rng>
Nov 06 05:55:52 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:55:52 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:55:52 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:55:52 user nova-compute[74903]:     </memballoon>
Nov 06 05:55:52 user nova-compute[74903]:   </devices>
Nov 06 05:55:52 user nova-compute[74903]: </domain>
Nov 06 05:55:52 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2049275497',display_name='tempest-VolumesAssistedSnapshotsTest-server-2049275497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2049275497',id=8,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlonfE76DqAW8aan8soNKSpWdvjiCcCJ+99uiEaJdFg7uO8jmwA0wgfElFsRzLg2wWi1sSGfD57sBdzjXqjrZk5irY4GISqa/BtmveuBVRWSmJF/am/xzZTBu5YpfF9eA==',key_name='tempest-keypair-625809800',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8118c385b9a4fb18fc87412ae6d7673',ramdisk_id='',reservation_id='r-ey9dfq5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1048584358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1048584358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a56f4a67554df7b957d26655ca86af',uuid=c6a9cf35-00cf-45b9-8727-267f150024a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converting VIF {"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG os_vif [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0f62b99-0167-5cf1-a86f-c3bd764e7f6a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8973d6-66, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c8973d6-66, col_values=(('qos', UUID('ebcf715b-8224-489b-bfd2-a1dd04c9978c')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c8973d6-66, col_values=(('external_ids', {'iface-id': '9c8973d6-665a-4a19-b06a-0c18069bbf07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:cc:f5', 'vm-uuid': 'c6a9cf35-00cf-45b9-8727-267f150024a9'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:52 user nova-compute[74903]: INFO os_vif [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66')
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] No VIF found with MAC fa:16:3e:da:cc:f5, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.neutron [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updated VIF entry in instance network info cache for port 9c8973d6-665a-4a19-b06a-0c18069bbf07. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG nova.network.neutron [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updating instance_info_cache with network_info: [{"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:55:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a45c9f3-514b-40e7-8e8e-bc8e7931e69d req-491ffa65-cc3b-4e8d-84f0-341aed59714b service nova] Releasing lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:55:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] No waiting events found dispatching network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:54 user nova-compute[74903]: WARNING nova.compute.manager [req-9d955333-2eb7-42d2-b9b5-89917b69e521 req-0e90feb4-8029-4474-a0a7-3cb2bc94f754 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received unexpected event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 for instance with vm_state building and task_state spawning.
Nov 06 05:55:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:55:56 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Instance spawned successfully.
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] No waiting events found dispatching network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:55:56 user nova-compute[74903]: WARNING nova.compute.manager [req-fa9e2e85-a047-4427-9e6e-6c7d710c31ca req-f46fc0e3-8614-4866-9e83-c9738eb1c0c1 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received unexpected event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 for instance with vm_state building and task_state spawning.
Nov 06 05:55:56 user nova-compute[74903]: INFO nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 06 05:55:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:55:56 user nova-compute[74903]: INFO nova.compute.manager [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Took 7.02 seconds to build instance.
Nov 06 05:55:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-984d1c71-80b1-4871-b693-e7dfc5de0db6 tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:55:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 05:56:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:07 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:56:07 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7493MB free_disk=25.653953552246094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dd9243d7-a43b-46d4-a669-ab1ff5460a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c6a9cf35-00cf-45b9-8727-267f150024a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:56:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:56:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:56:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:56:39 user nova-compute[74903]: INFO nova.compute.claims [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Claim successful on node user
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 05:56:39 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:56:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.policy [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77957c731a3c4178bfe1983b7c8a8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae8f99d90874f88a339acdd652206cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:56:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Creating image(s)
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "/opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "/opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Successfully created port: 164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk 1073741824" returned: 0 in 0.046s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Cannot resize image /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Ensure instance console log exists: /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Successfully updated port: 164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquired lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-changed-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Refreshing instance network info cache due to event network-changed-164f4823-bf57-4d2b-aac1-eb10b96a169d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] Acquiring lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Updating instance_info_cache with network_info: [{"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Releasing lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Instance network_info: |[{"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] Acquired lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.neutron [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Refreshing network info cache for port 164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Start _get_guest_xml network_info=[{"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:56:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:56:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1743869635',display_name='tempest-VolumesActionsTest-instance-1743869635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1743869635',id=9,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae8f99d90874f88a339acdd652206cc',ramdisk_id='',reservation_id='r-q3tvc35u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-173659946',owner_user_name='tempest-VolumesActionsTest-173659946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:56:40Z,user_data=None,user_id='77957c731a3c4178bfe1983b7c8a8f1e',uuid=f1ce6341-ad1a-4ca3-b86a-2ad850930b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converting VIF {"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lazy-loading 'pci_devices' on Instance uuid f1ce6341-ad1a-4ca3-b86a-2ad850930b0f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:56:41 user nova-compute[74903]:   <uuid>f1ce6341-ad1a-4ca3-b86a-2ad850930b0f</uuid>
Nov 06 05:56:41 user nova-compute[74903]:   <name>instance-00000009</name>
Nov 06 05:56:41 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:56:41 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:56:41 user nova-compute[74903]:   <metadata>
Nov 06 05:56:41 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:56:41 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:name>tempest-VolumesActionsTest-instance-1743869635</nova:name>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:56:41</nova:creationTime>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:56:41 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:56:41 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:owner>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:user uuid="77957c731a3c4178bfe1983b7c8a8f1e">tempest-VolumesActionsTest-173659946-project-member</nova:user>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:project uuid="4ae8f99d90874f88a339acdd652206cc">tempest-VolumesActionsTest-173659946</nova:project>
Nov 06 05:56:41 user nova-compute[74903]:       </nova:owner>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:56:41 user nova-compute[74903]:       <nova:ports>
Nov 06 05:56:41 user nova-compute[74903]:         <nova:port uuid="164f4823-bf57-4d2b-aac1-eb10b96a169d">
Nov 06 05:56:41 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 05:56:41 user nova-compute[74903]:         </nova:port>
Nov 06 05:56:41 user nova-compute[74903]:       </nova:ports>
Nov 06 05:56:41 user nova-compute[74903]:     </nova:instance>
Nov 06 05:56:41 user nova-compute[74903]:   </metadata>
Nov 06 05:56:41 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:56:41 user nova-compute[74903]:     <system>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="serial">f1ce6341-ad1a-4ca3-b86a-2ad850930b0f</entry>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="uuid">f1ce6341-ad1a-4ca3-b86a-2ad850930b0f</entry>
Nov 06 05:56:41 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:56:41 user nova-compute[74903]:     </system>
Nov 06 05:56:41 user nova-compute[74903]:   </sysinfo>
Nov 06 05:56:41 user nova-compute[74903]:   <os>
Nov 06 05:56:41 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:56:41 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:56:41 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:56:41 user nova-compute[74903]:   </os>
Nov 06 05:56:41 user nova-compute[74903]:   <features>
Nov 06 05:56:41 user nova-compute[74903]:     <acpi/>
Nov 06 05:56:41 user nova-compute[74903]:     <apic/>
Nov 06 05:56:41 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:56:41 user nova-compute[74903]:   </features>
Nov 06 05:56:41 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:56:41 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:56:41 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:56:41 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:56:41 user nova-compute[74903]:   </clock>
Nov 06 05:56:41 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:56:41 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:56:41 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:56:41 user nova-compute[74903]:   </cpu>
Nov 06 05:56:41 user nova-compute[74903]:   <devices>
Nov 06 05:56:41 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:56:41 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:56:41 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk"/>
Nov 06 05:56:41 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:56:41 user nova-compute[74903]:     </disk>
Nov 06 05:56:41 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:56:41 user nova-compute[74903]:       <mac address="fa:16:3e:23:ab:d8"/>
Nov 06 05:56:41 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:56:41 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:56:41 user nova-compute[74903]:       <target dev="tap164f4823-bf"/>
Nov 06 05:56:41 user nova-compute[74903]:     </interface>
Nov 06 05:56:41 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:56:41 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/console.log" append="off"/>
Nov 06 05:56:41 user nova-compute[74903]:     </serial>
Nov 06 05:56:41 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:56:41 user nova-compute[74903]:     <video>
Nov 06 05:56:41 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:56:41 user nova-compute[74903]:     </video>
Nov 06 05:56:41 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:56:41 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:56:41 user nova-compute[74903]:     </rng>
Nov 06 05:56:41 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:56:41 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:56:41 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:56:41 user nova-compute[74903]:     </memballoon>
Nov 06 05:56:41 user nova-compute[74903]:   </devices>
Nov 06 05:56:41 user nova-compute[74903]: </domain>
Nov 06 05:56:41 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1743869635',display_name='tempest-VolumesActionsTest-instance-1743869635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1743869635',id=9,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ae8f99d90874f88a339acdd652206cc',ramdisk_id='',reservation_id='r-q3tvc35u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-173659946',owner_user_name='tempest-VolumesActionsTest-173659946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:56:40Z,user_data=None,user_id='77957c731a3c4178bfe1983b7c8a8f1e',uuid=f1ce6341-ad1a-4ca3-b86a-2ad850930b0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converting VIF {"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG os_vif [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1abb762d-0497-5f47-b57b-147155afc98a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap164f4823-bf, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap164f4823-bf, col_values=(('qos', UUID('a3330781-71a0-4aa0-a347-050e13ddc9fe')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap164f4823-bf, col_values=(('external_ids', {'iface-id': '164f4823-bf57-4d2b-aac1-eb10b96a169d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ab:d8', 'vm-uuid': 'f1ce6341-ad1a-4ca3-b86a-2ad850930b0f'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:41 user nova-compute[74903]: INFO os_vif [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf')
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:56:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] No VIF found with MAC fa:16:3e:23:ab:d8, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:56:42 user nova-compute[74903]: DEBUG nova.network.neutron [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Updated VIF entry in instance network info cache for port 164f4823-bf57-4d2b-aac1-eb10b96a169d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:56:42 user nova-compute[74903]: DEBUG nova.network.neutron [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Updating instance_info_cache with network_info: [{"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:56:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6d20150-8a73-40a3-9544-b1574dfce6e6 req-5c414ab7-7092-42b2-b82a-e3fd550d5720 service nova] Releasing lock "refresh_cache-f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] No waiting events found dispatching network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:56:43 user nova-compute[74903]: WARNING nova.compute.manager [req-9736861e-a08f-46c0-beb2-d9c8c960f9d5 req-718815c9-c91c-452a-93f2-fd93256dcda7 service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received unexpected event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d for instance with vm_state building and task_state spawning.
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:56:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Instance spawned successfully.
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:56:45 user nova-compute[74903]: INFO nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:56:45 user nova-compute[74903]: INFO nova.compute.manager [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Took 6.11 seconds to build instance.
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] No waiting events found dispatching network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:56:45 user nova-compute[74903]: WARNING nova.compute.manager [req-f111d88f-89e2-449a-acbd-78c40ca923b9 req-3de4ab5e-3c96-4cfc-8e61-c88ccda14c9c service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received unexpected event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d for instance with vm_state active and task_state None.
Nov 06 05:56:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea2b3ff0-7141-418c-88f3-0c5e3bdb99ab tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.208s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:56:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:56:59 user nova-compute[74903]: INFO nova.compute.manager [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] instance snapshotting
Nov 06 05:56:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:56:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:56:59 user nova-compute[74903]: INFO nova.compute.claims [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Claim successful on node user
Nov 06 05:56:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Beginning live snapshot process
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:57:00 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.policy [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ccd7e52315424aaea03ff0c931cbeec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30951113bf204ff48659ef6726d35d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:57:00 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Creating image(s)
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "/opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "/opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "/opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67.delta 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67.delta 1073741824" returned: 0 in 0.061s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:00 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 05:57:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74903) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 06 05:57:00 user nova-compute[74903]: INFO nova.virt.libvirt.host [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] UEFI support detected
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:01 user nova-compute[74903]: INFO nova.compute.manager [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Rescuing
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk 1073741824" returned: 0 in 0.075s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Cannot resize image /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Ensure instance console log exists: /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Successfully created port: fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 05:57:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67.delta /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:02 user nova-compute[74903]: WARNING nova.compute.manager [req-56c9de9b-eb4c-4c39-8a45-1ac1b939e21c req-370b19fa-1332-4d58-8e48-133ba6053c49 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state rescuing.
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Successfully updated port: fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquired lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67.delta /opt/stack/data/nova/instances/snapshots/tmpyhgvftqg/0c93a1da2c284906b9d4207bd77bff67" returned: 0 in 0.428s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Snapshot extracted, beginning image upload
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance destroyed successfully.
Nov 06 05:57:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Attempting rescue
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 05:57:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Creating image(s)
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'trusted_certs' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue" returned: 0 in 0.044s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'migration_context' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.base [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<f023ad69-b053-4fae-a05a-dc66bbd76bfc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start _get_guest_xml network_info=[{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:70:d6:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.base [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<f023ad69-b053-4fae-a05a-dc66bbd76bfc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'numa_topology' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.base [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<f023ad69-b053-4fae-a05a-dc66bbd76bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.neutron [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Updating instance_info_cache with network_info: [{"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'vcpu_model' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Releasing lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Instance network_info: |[{"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Start _get_guest_xml network_info=[{"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.base [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<f023ad69-b053-4fae-a05a-dc66bbd76bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-707951993',display_name='tempest-ServerRescueNegativeTestJSON-server-707951993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-707951993',id=5,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-rbt5057z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:30Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=f023ad69-b053-4fae-a05a-dc66bbd76bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:70:d6:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:70:d6:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1528741194',display_name='tempest-ServersNegativeTestJSON-server-1528741194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1528741194',id=10,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-dv8bgyc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:01Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=9dc53b4e-ca95-4225-abf2-c48fa3880cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dc53b4e-ca95-4225-abf2-c48fa3880cf1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.objects.base [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<f023ad69-b053-4fae-a05a-dc66bbd76bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:57:03 user nova-compute[74903]:   <uuid>f023ad69-b053-4fae-a05a-dc66bbd76bfc</uuid>
Nov 06 05:57:03 user nova-compute[74903]:   <name>instance-00000005</name>
Nov 06 05:57:03 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:57:03 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:57:03 user nova-compute[74903]:   <metadata>
Nov 06 05:57:03 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:57:03 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-707951993</nova:name>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:57:03</nova:creationTime>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:57:03 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:owner>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:owner>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:ports>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:port uuid="f2fa5c41-e062-4b4a-aaa2-95dcad72c58f">
Nov 06 05:57:03 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 05:57:03 user nova-compute[74903]:         </nova:port>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:ports>
Nov 06 05:57:03 user nova-compute[74903]:     </nova:instance>
Nov 06 05:57:03 user nova-compute[74903]:   </metadata>
Nov 06 05:57:03 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:57:03 user nova-compute[74903]:     <system>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="serial">f023ad69-b053-4fae-a05a-dc66bbd76bfc</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="uuid">f023ad69-b053-4fae-a05a-dc66bbd76bfc</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:57:03 user nova-compute[74903]:     </system>
Nov 06 05:57:03 user nova-compute[74903]:   </sysinfo>
Nov 06 05:57:03 user nova-compute[74903]:   <os>
Nov 06 05:57:03 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:57:03 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:57:03 user nova-compute[74903]:   </os>
Nov 06 05:57:03 user nova-compute[74903]:   <features>
Nov 06 05:57:03 user nova-compute[74903]:     <acpi/>
Nov 06 05:57:03 user nova-compute[74903]:     <apic/>
Nov 06 05:57:03 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:57:03 user nova-compute[74903]:   </features>
Nov 06 05:57:03 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:57:03 user nova-compute[74903]:   </clock>
Nov 06 05:57:03 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:57:03 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:57:03 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:57:03 user nova-compute[74903]:   </cpu>
Nov 06 05:57:03 user nova-compute[74903]:   <devices>
Nov 06 05:57:03 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:57:03 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:57:03 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue"/>
Nov 06 05:57:03 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:     </disk>
Nov 06 05:57:03 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:57:03 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:57:03 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk"/>
Nov 06 05:57:03 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:     </disk>
Nov 06 05:57:03 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:57:03 user nova-compute[74903]:       <mac address="fa:16:3e:70:d6:fd"/>
Nov 06 05:57:03 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:57:03 user nova-compute[74903]:       <target dev="tapf2fa5c41-e0"/>
Nov 06 05:57:03 user nova-compute[74903]:     </interface>
Nov 06 05:57:03 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:57:03 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/console.log" append="off"/>
Nov 06 05:57:03 user nova-compute[74903]:     </serial>
Nov 06 05:57:03 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:57:03 user nova-compute[74903]:     <video>
Nov 06 05:57:03 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:     </video>
Nov 06 05:57:03 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:57:03 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:57:03 user nova-compute[74903]:     </rng>
Nov 06 05:57:03 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:57:03 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:57:03 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:57:03 user nova-compute[74903]:     </memballoon>
Nov 06 05:57:03 user nova-compute[74903]:   </devices>
Nov 06 05:57:03 user nova-compute[74903]: </domain>
Nov 06 05:57:03 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:57:03 user nova-compute[74903]:   <uuid>9dc53b4e-ca95-4225-abf2-c48fa3880cf1</uuid>
Nov 06 05:57:03 user nova-compute[74903]:   <name>instance-0000000a</name>
Nov 06 05:57:03 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:57:03 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:57:03 user nova-compute[74903]:   <metadata>
Nov 06 05:57:03 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:57:03 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:name>tempest-ServersNegativeTestJSON-server-1528741194</nova:name>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:57:03</nova:creationTime>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:57:03 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:owner>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:user uuid="ccd7e52315424aaea03ff0c931cbeec8">tempest-ServersNegativeTestJSON-668548580-project-member</nova:user>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:project uuid="30951113bf204ff48659ef6726d35d25">tempest-ServersNegativeTestJSON-668548580</nova:project>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:owner>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:57:03 user nova-compute[74903]:       <nova:ports>
Nov 06 05:57:03 user nova-compute[74903]:         <nova:port uuid="fd522096-8e16-4931-84c1-839188a751f8">
Nov 06 05:57:03 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 05:57:03 user nova-compute[74903]:         </nova:port>
Nov 06 05:57:03 user nova-compute[74903]:       </nova:ports>
Nov 06 05:57:03 user nova-compute[74903]:     </nova:instance>
Nov 06 05:57:03 user nova-compute[74903]:   </metadata>
Nov 06 05:57:03 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:57:03 user nova-compute[74903]:     <system>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="serial">9dc53b4e-ca95-4225-abf2-c48fa3880cf1</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="uuid">9dc53b4e-ca95-4225-abf2-c48fa3880cf1</entry>
Nov 06 05:57:03 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:57:03 user nova-compute[74903]:     </system>
Nov 06 05:57:03 user nova-compute[74903]:   </sysinfo>
Nov 06 05:57:03 user nova-compute[74903]:   <os>
Nov 06 05:57:03 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:57:03 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:57:03 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:57:03 user nova-compute[74903]:   </os>
Nov 06 05:57:03 user nova-compute[74903]:   <features>
Nov 06 05:57:03 user nova-compute[74903]:     <acpi/>
Nov 06 05:57:03 user nova-compute[74903]:     <apic/>
Nov 06 05:57:03 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:57:03 user nova-compute[74903]:   </features>
Nov 06 05:57:03 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:57:03 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:57:03 user nova-compute[74903]:   </clock>
Nov 06 05:57:03 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:57:03 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:57:03 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:57:03 user nova-compute[74903]:   </cpu>
Nov 06 05:57:03 user nova-compute[74903]:   <devices>
Nov 06 05:57:03 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:57:03 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:57:03 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk"/>
Nov 06 05:57:03 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:     </disk>
Nov 06 05:57:03 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:57:03 user nova-compute[74903]:       <mac address="fa:16:3e:a0:6a:71"/>
Nov 06 05:57:03 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:57:03 user nova-compute[74903]:       <target dev="tapfd522096-8e"/>
Nov 06 05:57:03 user nova-compute[74903]:     </interface>
Nov 06 05:57:03 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:57:03 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/console.log" append="off"/>
Nov 06 05:57:03 user nova-compute[74903]:     </serial>
Nov 06 05:57:03 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:57:03 user nova-compute[74903]:     <video>
Nov 06 05:57:03 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:03 user nova-compute[74903]:     </video>
Nov 06 05:57:03 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:57:03 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:57:03 user nova-compute[74903]:     </rng>
Nov 06 05:57:03 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:57:03 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:57:03 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:57:03 user nova-compute[74903]:     </memballoon>
Nov 06 05:57:03 user nova-compute[74903]:   </devices>
Nov 06 05:57:03 user nova-compute[74903]: </domain>
Nov 06 05:57:03 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1528741194',display_name='tempest-ServersNegativeTestJSON-server-1528741194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1528741194',id=10,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-dv8bgyc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:01Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=9dc53b4e-ca95-4225-abf2-c48fa3880cf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG os_vif [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e573d6a-339e-5faf-ab8b-8d05b8a93920', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:57:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance destroyed successfully.
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd522096-8e, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd522096-8e, col_values=(('qos', UUID('5d9613bb-7be8-4867-9f82-71bd4dea6a4d')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd522096-8e, col_values=(('external_ids', {'iface-id': 'fd522096-8e16-4931-84c1-839188a751f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:6a:71', 'vm-uuid': '9dc53b4e-ca95-4225-abf2-c48fa3880cf1'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:03 user nova-compute[74903]: INFO os_vif [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e')
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:70:d6:fd, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] No VIF found with MAC fa:16:3e:a0:6a:71, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-changed-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Refreshing instance network info cache due to event network-changed-fd522096-8e16-4931-84c1-839188a751f8. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Acquiring lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Acquired lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Refreshing network info cache for port fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Updated VIF entry in instance network info cache for port fd522096-8e16-4931-84c1-839188a751f8. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Updating instance_info_cache with network_info: [{"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Releasing lock "refresh_cache-9dc53b4e-ca95-4225-abf2-c48fa3880cf1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:05 user nova-compute[74903]: WARNING nova.compute.manager [req-3b1df6d8-fd37-426c-924b-7bb151191bca req-35d5b098-1b9e-4279-aff7-7b2a74eba355 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state rescuing.
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:57:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Snapshot image upload complete
Nov 06 05:57:05 user nova-compute[74903]: INFO nova.compute.manager [None req-53f82fc7-074a-4e97-b6d5-d62602b36e4b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Took 5.72 seconds to snapshot the instance on the hypervisor.
Nov 06 05:57:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] No waiting events found dispatching network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:06 user nova-compute[74903]: WARNING nova.compute.manager [req-87a41ff5-827c-402b-93db-b865384320a0 req-0aae6bed-ac41-476b-9858-75abd5e5ed24 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received unexpected event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 for instance with vm_state building and task_state spawning.
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:06 user nova-compute[74903]: WARNING nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state rescuing.
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:06 user nova-compute[74903]: WARNING nova.compute.manager [req-39c05e95-9036-4ecb-b722-b1f4e2b9fe26 req-8c64f8c5-3059-45c1-8933-3eef6283e19b service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state active and task_state rescuing.
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing instance network info cache due to event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated VIF entry in instance network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cf4ce0d-6eee-4800-b579-eaaf4b5df410 req-c4db0ad3-21b2-4635-bb0a-58ec2cb7f8fd service nova] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] No waiting events found dispatching network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:08 user nova-compute[74903]: WARNING nova.compute.manager [req-830fae82-2e58-4826-8af1-be35017345ac req-8b4ade67-3525-41ec-be6d-602137a6938b service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received unexpected event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 for instance with vm_state building and task_state spawning.
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:57:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Instance spawned successfully.
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-99e63c98-4dc7-4fee-b8a3-3276f0f8e24a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:57:08 user nova-compute[74903]: INFO nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Took 8.17 seconds to spawn the instance on the hypervisor.
Nov 06 05:57:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:09 user nova-compute[74903]: INFO nova.compute.manager [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Took 9.18 seconds to build instance.
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-09331826-1380-45ca-bea2-91525ad8addd tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.311s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=25.52035903930664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dd9243d7-a43b-46d4-a669-ab1ff5460a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c6a9cf35-00cf-45b9-8727-267f150024a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f1ce6341-ad1a-4ca3-b86a-2ad850930b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9dc53b4e-ca95-4225-abf2-c48fa3880cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:57:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:57:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:57:17 user nova-compute[74903]: INFO nova.compute.claims [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Claim successful on node user
Nov 06 05:57:17 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:57:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:57:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:57:18 user nova-compute[74903]: INFO nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Booting with volume 72628c58-0835-4652-a5c3-482eb93aab93 at /dev/vda
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.policy [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b54e5d18967a4c71ad0a6d74a6d4fbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bd8bf20dc14f17b2af834a5fa96602', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:18 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpb_v5dhze/privsep.sock']
Nov 06 05:57:18 user sudo[86745]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpb_v5dhze/privsep.sock
Nov 06 05:57:18 user sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 05:57:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully created port: 1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully created port: 073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:19 user sudo[86745]: pam_unix(sudo:session): session closed for user root
Nov 06 05:57:19 user nova-compute[74903]: INFO oslo.privsep.daemon [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Spawned new privsep daemon via rootwrap
Nov 06 05:57:19 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 05:57:19 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 05:57:19 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 06 05:57:19 user nova-compute[74903]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86748
Nov 06 05:57:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40612e4-da6c-4458-a12e-cf4c4dc4e3ba]: (2,) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831c103-34cc-46a0-b1e0-59d0ef41c100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: WARNING os_brick.initiator.connectors.nvmeof [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully created port: 65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e7714-0a4c-49c1-b0e2-aba293ac0a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83420640-19a8-473d-bd78-815adee1c4fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23b5be-8787-405c-9922-ce6d86012d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:20 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:57:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bcc75a-b916-4c13-80e2-a436d2b8abd7]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== get_connector_properties: return (1787ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating existing volume attachment record: c84e1b15-e7f2-4f91-96c0-cb254eab2854 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully created port: 20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully created port: dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: 1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-1843bb97-2178-4df3-aa6a-d6472964d761. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port 1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9d3ef74-d29e-4155-a850-4ab583af970e req-d3792b30-b828-472e-89c3-fe271439227b service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-d0742d33-c506-49a8-8629-5d4ca630014e. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-e0024f2e-1da9-4744-a3f9-d6805bbe8657. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: 073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7abea8e-b624-47e7-8caa-0da05878fcdb req-0855a131-1d3a-4ecd-a454-ac934f950fd0 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:25 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: 65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-073f527c-ea48-488a-bc51-56124b43fa5d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port 073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-65a5dea2-48f7-455b-9cd8-9f08ca8244a9. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port 65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: 20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44e8da0b-1764-4d6a-97f9-085a5d017ba7 req-44bcc8ed-f219-4f92-a552-d08c69c7a2e0 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lazy-loading 'flavor' on Instance uuid dd9243d7-a43b-46d4-a669-ab1ff5460a7c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.143s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Successfully updated port: dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:27 user nova-compute[74903]: INFO nova.compute.manager [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Attaching volume 76821a5c-e8af-4c34-be3c-8238c7d4786e to /dev/vdb
Nov 06 05:57:27 user nova-compute[74903]: DEBUG os_brick.utils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8517f6-267d-4f33-a8c5-34894c55b57b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e206247-a4c5-4260-8ec8-10635aaf2bc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[618cba25-b2ef-427c-ad6a-7e17645a9fd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b45e62-6bd3-431d-970c-3af2d4af7782]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:28 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc677863-0d7a-4a57-9896-ae4f8cab536a]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG os_brick.utils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Updating existing volume attachment record: c822ed7f-e921-4cbb-be6c-3667ba07156a {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-20a57265-77dc-4c93-8c3a-b1055941b513. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance network_info: |[{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:57:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port 20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updated VIF entry in instance network info cache for port 20a57265-77dc-4c93-8c3a-b1055941b513. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-changed-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Refreshing instance network info cache due to event network-changed-98b72f04-2d16-44fb-af90-ac3ba4aec556. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquiring lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquired lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Refreshing network info cache for port 98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updated VIF entry in instance network info cache for port 98b72f04-2d16-44fb-af90-ac3ba4aec556. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating instance_info_cache with network_info: [{"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Releasing lock "refresh_cache-814088c5-7ba1-4596-9a8d-8135ab4b8668" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-dfe77107-4f8c-445b-afd3-417b8de17897. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updated VIF entry in instance network info cache for port dfe77107-4f8c-445b-afd3-417b8de17897. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0669a068-57e6-43b0-b67a-f2a5ce6963f4 req-2b9779fe-c4c7-4959-8c23-dbc7fceae376 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-changed-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Refreshing instance network info cache due to event network-changed-9c8973d6-665a-4a19-b06a-0c18069bbf07. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] Acquiring lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] Acquired lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Refreshing network info cache for port 9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.objects.instance [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lazy-loading 'flavor' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updated VIF entry in instance network info cache for port 9c8973d6-665a-4a19-b06a-0c18069bbf07. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updating instance_info_cache with network_info: [{"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-872c88fb-59bb-4197-b596-797a1c62534b req-fad13d8c-48f9-4bbb-b5bc-8d2c2e051f6c service nova] Releasing lock "refresh_cache-c6a9cf35-00cf-45b9-8727-267f150024a9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:41 user nova-compute[74903]: INFO nova.compute.manager [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Attaching volume d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb to /dev/vdb
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d01f0e-08da-4ff0-be53-2fd9c201ca47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2abbe7-c22a-4b7b-8dd0-91abaa7b0513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0f151d-275f-4e08-91ef-595432eed9bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c9bbc-88c1-475e-aa9d-c2fd05183c9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:41 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:57:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[82876ea9-05f6-463c-8e18-b0e817dd7944]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:41 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updating existing volume attachment record: 68465557-2007-4faf-b0ef-3098eb7381d7 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:57:43 user nova-compute[74903]: INFO nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Booting with volume 256c316a-b692-43fe-a01b-081cb29dbe46 at /dev/vdb
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042c111-d14e-4c30-9723-9be3b2ab2b21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d285746-31cd-4ac0-9851-60a35fe4795b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[672927cf-2d5e-49b9-9729-e0acbe402406]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb805f-48d2-4994-a1e6-3fa17c6a2d9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:43 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:57:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38b3011-cfe6-44b3-8c3d-c1a6cb7027fc]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating existing volume attachment record: 7748a4f3-d7ef-4aaf-aa4e-b0296670e3d7 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:57:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:57:44 user nova-compute[74903]: INFO nova.compute.claims [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Claim successful on node user
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:57:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.policy [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a304c402d6c346ff80715df1d2b10107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea5f20779e746cdae6c855ac1b044a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:57:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Creating image(s)
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "/opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "/opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk 1073741824" returned: 0 in 0.056s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Successfully created port: d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Cannot resize image /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Ensure instance console log exists: /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:46 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Successfully updated port: d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquired lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-changed-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Refreshing instance network info cache due to event network-changed-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] Acquiring lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updating instance_info_cache with network_info: [{"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Releasing lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Instance network_info: |[{"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] Acquired lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Refreshing network info cache for port d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Start _get_guest_xml network_info=[{"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:57:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-309037987',display_name='tempest-VolumesSnapshotTestJSON-instance-309037987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-309037987',id=12,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhZmErjXa0fabvRV+DjEpbrO4TXmcQTG7If28g5kpMbI/aLeD0L5gbyFLBy248cHEbOqI7DHVA9Ed1f4DPKfJPMn41o9pZspDRBJW44DfkTcj67U4c/DvZZ0gfAv4wtZg==',key_name='tempest-keypair-632885547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-x9wt8pa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=9bbe873d-de34-4367-8ff5-d2e1b98b23a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:57:47 user nova-compute[74903]:   <uuid>9bbe873d-de34-4367-8ff5-d2e1b98b23a3</uuid>
Nov 06 05:57:47 user nova-compute[74903]:   <name>instance-0000000c</name>
Nov 06 05:57:47 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:57:47 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:57:47 user nova-compute[74903]:   <metadata>
Nov 06 05:57:47 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:57:47 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-309037987</nova:name>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:57:47</nova:creationTime>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:57:47 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:57:47 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:owner>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:user uuid="a304c402d6c346ff80715df1d2b10107">tempest-VolumesSnapshotTestJSON-453337636-project-member</nova:user>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:project uuid="8ea5f20779e746cdae6c855ac1b044a4">tempest-VolumesSnapshotTestJSON-453337636</nova:project>
Nov 06 05:57:47 user nova-compute[74903]:       </nova:owner>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:57:47 user nova-compute[74903]:       <nova:ports>
Nov 06 05:57:47 user nova-compute[74903]:         <nova:port uuid="d69689dd-cfb2-40c5-b1fa-c3ef299f41bf">
Nov 06 05:57:47 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 05:57:47 user nova-compute[74903]:         </nova:port>
Nov 06 05:57:47 user nova-compute[74903]:       </nova:ports>
Nov 06 05:57:47 user nova-compute[74903]:     </nova:instance>
Nov 06 05:57:47 user nova-compute[74903]:   </metadata>
Nov 06 05:57:47 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:57:47 user nova-compute[74903]:     <system>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="serial">9bbe873d-de34-4367-8ff5-d2e1b98b23a3</entry>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="uuid">9bbe873d-de34-4367-8ff5-d2e1b98b23a3</entry>
Nov 06 05:57:47 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:57:47 user nova-compute[74903]:     </system>
Nov 06 05:57:47 user nova-compute[74903]:   </sysinfo>
Nov 06 05:57:47 user nova-compute[74903]:   <os>
Nov 06 05:57:47 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:57:47 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:57:47 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:57:47 user nova-compute[74903]:   </os>
Nov 06 05:57:47 user nova-compute[74903]:   <features>
Nov 06 05:57:47 user nova-compute[74903]:     <acpi/>
Nov 06 05:57:47 user nova-compute[74903]:     <apic/>
Nov 06 05:57:47 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:57:47 user nova-compute[74903]:   </features>
Nov 06 05:57:47 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:57:47 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:57:47 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:57:47 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:57:47 user nova-compute[74903]:   </clock>
Nov 06 05:57:47 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:57:47 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:57:47 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:57:47 user nova-compute[74903]:   </cpu>
Nov 06 05:57:47 user nova-compute[74903]:   <devices>
Nov 06 05:57:47 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:57:47 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:57:47 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk"/>
Nov 06 05:57:47 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:57:47 user nova-compute[74903]:     </disk>
Nov 06 05:57:47 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:57:47 user nova-compute[74903]:       <mac address="fa:16:3e:51:8d:5d"/>
Nov 06 05:57:47 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:47 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:57:47 user nova-compute[74903]:       <target dev="tapd69689dd-cf"/>
Nov 06 05:57:47 user nova-compute[74903]:     </interface>
Nov 06 05:57:47 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:57:47 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/console.log" append="off"/>
Nov 06 05:57:47 user nova-compute[74903]:     </serial>
Nov 06 05:57:47 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:57:47 user nova-compute[74903]:     <video>
Nov 06 05:57:47 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:57:47 user nova-compute[74903]:     </video>
Nov 06 05:57:47 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:57:47 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:57:47 user nova-compute[74903]:     </rng>
Nov 06 05:57:47 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:57:47 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:57:47 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:57:47 user nova-compute[74903]:     </memballoon>
Nov 06 05:57:47 user nova-compute[74903]:   </devices>
Nov 06 05:57:47 user nova-compute[74903]: </domain>
Nov 06 05:57:47 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-309037987',display_name='tempest-VolumesSnapshotTestJSON-instance-309037987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-309037987',id=12,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhZmErjXa0fabvRV+DjEpbrO4TXmcQTG7If28g5kpMbI/aLeD0L5gbyFLBy248cHEbOqI7DHVA9Ed1f4DPKfJPMn41o9pZspDRBJW44DfkTcj67U4c/DvZZ0gfAv4wtZg==',key_name='tempest-keypair-632885547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-x9wt8pa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=9bbe873d-de34-4367-8ff5-d2e1b98b23a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG os_vif [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa0fdba2-e4d3-59a0-8f38-65037fd13cb6', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69689dd-cf, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd69689dd-cf, col_values=(('qos', UUID('3519135e-9acd-42d3-9cf1-8aa475e2807c')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd69689dd-cf, col_values=(('external_ids', {'iface-id': 'd69689dd-cfb2-40c5-b1fa-c3ef299f41bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:8d:5d', 'vm-uuid': '9bbe873d-de34-4367-8ff5-d2e1b98b23a3'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:47 user nova-compute[74903]: INFO os_vif [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf')
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No VIF found with MAC fa:16:3e:51:8d:5d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updated VIF entry in instance network info cache for port d69689dd-cfb2-40c5-b1fa-c3ef299f41bf. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updating instance_info_cache with network_info: [{"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8c5a374-14a0-4fc0-9640-5cdfbdec6213 req-ba14828e-5f0b-4277-80ad-2665e32e91d1 service nova] Releasing lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] No waiting events found dispatching network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:49 user nova-compute[74903]: WARNING nova.compute.manager [req-5523e879-bd29-42de-bedf-be7d22ced23e req-bfde8d52-889c-48bf-b3d5-d8e9f1cd04ed service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received unexpected event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf for instance with vm_state building and task_state spawning.
Nov 06 05:57:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] No waiting events found dispatching network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:57:51 user nova-compute[74903]: WARNING nova.compute.manager [req-c378b531-8ce5-44e4-8329-cd0efc8b92d1 req-e3d1e7c3-3b1f-4bda-bd94-c8d4659764a3 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received unexpected event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf for instance with vm_state building and task_state spawning.
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:57:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Instance spawned successfully.
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:57:51 user nova-compute[74903]: INFO nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:57:51 user nova-compute[74903]: INFO nova.compute.manager [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Took 6.74 seconds to build instance.
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0518761e-1b45-40b1-9d14-1d977ab00f85 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.871s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connector [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Factory for ISCSI on None {{(pid=74903) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqpOGulL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:57:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:57:51 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3db3cd0-3469-4a22-a1f1-39f46aeb5da2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:57:51 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a7b8e2-528d-4ee1-9138-90afed17b690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e] added
Nov 06 05:57:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc58aa-b886-475b-aa08-3ae4b81493c9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ab593-9836-4ee9-a150-0894aaf273c1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqpOGulL {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqpOGulL" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b68d0cc-f3a3-402d-8c77-eb995eefd2f2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqpOGulL'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2643e0-a54d-40d4-a627-97299642cbf5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c74559-9bdc-4117-b2c3-347adf889aea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 05:57:51 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 05:57:51 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:57:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 05:57:51 user nova-compute[74903]: 
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[04750079-45e8-4b81-bfd0-98a594eb020b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260]
Nov 06 05:57:51 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260] successful.
Nov 06 05:57:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e3f69-b08e-4fff-9345-33f9e5073ce8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051f2ab-bda0-427a-83ec-8892af74a8bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)
Nov 06 05:57:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)
Nov 06 05:57:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e1a7c3-d48e-4bfd-8f85-b045ab01d317]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:57:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqpOGulL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lazy-loading 'flavor' on Instance uuid 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:57:52 user nova-compute[74903]: INFO nova.compute.manager [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Attaching volume ae0dfe4e-35b6-4366-a592-12b332a3aef2 to /dev/sdc
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.utils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c881d72-32e8-4a05-ba0e-dddde575191e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b982a074-7ac9-4617-be1b-116ea312925d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5aef75-8ccc-4751-81fa-21c105242280]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a63bc-c98e-49a6-bd55-bce4fa8b4911]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26432393464636139', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432393464636139', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:57:52 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:57:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[77868823-2cc3-4bbf-a04f-31845824051b]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG os_brick.utils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:57:52 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating existing volume attachment record: 1f3db367-53ea-48e1-8021-509817e52d2f {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:57:53 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lazy-loading 'flavor' on Instance uuid dd9243d7-a43b-46d4-a669-ab1ff5460a7c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:57:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 05:57:53 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:57:53 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 05:57:53 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 05:57:53 user nova-compute[74903]:   <serial>76821a5c-e8af-4c34-be3c-8238c7d4786e</serial>
Nov 06 05:57:53 user nova-compute[74903]: </disk>
Nov 06 05:57:53 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 05:57:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:57:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] No VIF found with MAC fa:16:3e:a2:90:4b, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:57:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:57:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:58:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:58:07 user nova-compute[74903]: INFO nova.compute.claims [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Claim successful on node user
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f3ec7cd-085d-4864-b097-a2f86e61c6e0 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.764s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.791s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:58:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:58:08 user nova-compute[74903]: INFO nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Booting with volume c8e855e8-844a-451b-ad93-d91d4e30a669 at /dev/vdc
Nov 06 05:58:08 user nova-compute[74903]: INFO nova.virt.block_device [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Booting with blank volume at /dev/vda
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[37603425-a58d-4b57-b55c-9049043e5113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c399f-a6a9-4dfd-a252-e963ce56b05b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.policy [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d10322732ce4e93b049be06ad946cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af82cdc03f0241bb8de82b8fb9d7a66c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d712a59-7e4e-4aa5-9065-0d733dd7b16a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e47e3d4-e20c-4667-88e6-1cb8654e67ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:09 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd34b20-3a25-479e-995d-4561b9f15675]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG os_brick.utils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating existing volume attachment record: d5214da4-dab4-4d97-86eb-92971b6a75e5 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:09 user nova-compute[74903]: INFO nova.compute.manager [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Terminating instance
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-unplugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] No waiting events found dispatching network-vif-unplugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c101aca6-90e8-4a47-b8df-09bff247fdd7 req-4aa4b4ed-624d-40ac-94df-abd6d6ce7ba4 service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-unplugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Instance destroyed successfully.
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lazy-loading 'resources' on Instance uuid dd9243d7-a43b-46d4-a669-ab1ff5460a7c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Successfully created port: ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1294840264',display_name='tempest-DeleteServersTestJSON-server-1294840264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1294840264',id=4,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='453949ee6d354d8dafac951e23a1b9aa',ramdisk_id='',reservation_id='r-jnyaqgdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1225512574',owner_user_name='tempest-DeleteServersTestJSON-1225512574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:55:29Z,user_data=None,user_id='9d8303851d874444b6007b48d120b1ec',uuid=dd9243d7-a43b-46d4-a669-ab1ff5460a7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converting VIF {"id": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "address": "fa:16:3e:a2:90:4b", "network": {"id": "b49aedd5-709d-4805-a734-2c21330592df", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1004376401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453949ee6d354d8dafac951e23a1b9aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa4c4a90-9a", "ovs_interfaceid": "aa4c4a90-9a55-4cd3-804d-e10c2a07773c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_vif [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa4c4a90-9a, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8729fb5f-1587-4f28-b7d8-4405978c9a01) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: INFO os_vif [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:4b,bridge_name='br-int',has_traffic_filtering=True,id=aa4c4a90-9a55-4cd3-804d-e10c2a07773c,network=Network(b49aedd5-709d-4805-a734-2c21330592df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa4c4a90-9a')
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqpOGulL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:10 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f873ab7-1346-4de4-aae0-0f43555f8054]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 05:58:10 user nova-compute[74903]: No targets found.
Nov 06 05:58:10 user nova-compute[74903]: iSNS:
Nov 06 05:58:10 user nova-compute[74903]: No targets found.
Nov 06 05:58:10 user nova-compute[74903]: STATIC:
Nov 06 05:58:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e
Nov 06 05:58:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:10 user nova-compute[74903]: FIRMWARE:
Nov 06 05:58:10 user nova-compute[74903]: No targets found.
Nov 06 05:58:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 05:58:10 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 05:58:10 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[253a773f-ac33-4067-9610-fa23398ae65e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea9247d-d351-41f3-9b84-b276bbea4e7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)
Nov 06 05:58:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e (non-flash)
Nov 06 05:58:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28468af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6fb1fb-d07b-409e-a8eb-330359c6e1ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[114b5a99-7f74-4216-9632-df5405c0b4cb]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[94716a7d-2047-4a75-b510-8cd0ee3d0334]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f36ddf-7fad-4d73-b157-614f85efb2a5]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c386842-0f79-4d8d-af4f-57bc7af9b32a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d167fb4-276e-4d6e-81d8-421505a9e7c5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260]
Nov 06 05:58:10 user nova-compute[74903]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76821a5c-e8af-4c34-be3c-8238c7d4786e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6093c092-a30d-4c05-a04c-ea5e5455c88a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] <== disconnect_volume: return (333ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 05:58:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Deleting instance files /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c_del
Nov 06 05:58:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Deletion of /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c_del complete
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json" returned: 1 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk --force-share --output=json' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:10 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000004, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/dd9243d7-a43b-46d4-a669-ab1ff5460a7c/disk
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:10 user nova-compute[74903]: INFO nova.compute.manager [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Successfully updated port: ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-changed-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Refreshing instance network info cache due to event network-changed-ad661255-20e8-4a90-a42f-3a7d37b4c04d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] Acquiring lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] No waiting events found dispatching network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:11 user nova-compute[74903]: WARNING nova.compute.manager [req-3462d82a-8b38-4e75-bbc6-c6e89b6e610d req-00ffb61f-3fb5-405a-bfcd-2d009f26a7ce service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received unexpected event network-vif-plugged-aa4c4a90-9a55-4cd3-804d-e10c2a07773c for instance with vm_state active and task_state deleting.
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:11 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:58:11 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:58:11 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7151MB free_disk=25.48349380493164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:12 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Took 1.28 seconds to deallocate network for instance.
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dd9243d7-a43b-46d4-a669-ab1ff5460a7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c6a9cf35-00cf-45b9-8727-267f150024a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f1ce6341-ad1a-4ca3-b86a-2ad850930b0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9dc53b4e-ca95-4225-abf2-c48fa3880cf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance ce617b70-08a4-492d-a9ec-138cc4990e20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance network_info: |[{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.network.neutron [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Refreshing network info cache for port ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.network.neutron [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updated VIF entry in instance network info cache for port ad661255-20e8-4a90-a42f-3a7d37b4c04d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG nova.network.neutron [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-834f5430-c29d-4ebe-adf6-091f02624fc3 req-978b2e20-ff71-46cc-877f-55b5aca207fb service nova] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-07600120-bf28-4081-9f12-46357cd433a1 req-75edf2d5-1dea-4c1e-8b80-eb09367670ac service nova] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Received event network-vif-deleted-aa4c4a90-9a55-4cd3-804d-e10c2a07773c {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:58:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUXhfbZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:17 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:17 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:17 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f436dec-038a-4001-bcf9-be7acb5a1d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:58:17 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01998c-8911-437b-bb34-5764b6d27ce9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2] added
Nov 06 05:58:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[700152d0-3fec-49a9-93a6-08209227e68e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb08c4-ab06-4c34-afbd-253936a1e6be]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUXhfbZd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUXhfbZd" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eab49d-a14e-4433-9add-d0c35487f6e5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUXhfbZd'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7efb3-d292-42bb-b7b2-0b423ed43daa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c75456-f692-4340-9ae2-78a90aae1750]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 05:58:17 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 05:58:17 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:17 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 05:58:17 user nova-compute[74903]: 
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e8c5d8-0c1c-4329-92a5-5637968bc04c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260]
Nov 06 05:58:17 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[88502077-5e93-44d3-8396-fb444dd5d8eb]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454b1c1-6731-4cda-9620-43503195ae67]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[090fb383-a2a5-4825-b3b8-1971fa3cc189]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:18 user nova-compute[74903]: INFO nova.compute.manager [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] [instance: dd9243d7-a43b-46d4-a669-ab1ff5460a7c] Took 6.53 seconds to detach 1 volumes for instance.
Nov 06 05:58:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUXhfbZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23162333330646238', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162333330646238', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lazy-loading 'flavor' on Instance uuid 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 05:58:18 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:18 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 05:58:18 user nova-compute[74903]:   <target dev="sdc" bus="scsi"/>
Nov 06 05:58:18 user nova-compute[74903]:   <serial>ae0dfe4e-35b6-4366-a592-12b332a3aef2</serial>
Nov 06 05:58:18 user nova-compute[74903]:   <address type="drive" controller="0" unit="2"/>
Nov 06 05:58:18 user nova-compute[74903]: </disk>
Nov 06 05:58:18 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 05:58:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:19 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Deleted allocations for instance dd9243d7-a43b-46d4-a669-ab1ff5460a7c
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No BDM found with device name sda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] No VIF found with MAC fa:16:3e:9d:37:6b, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d6f3744-c6f4-4b83-9aef-2b753b4d2712 tempest-DeleteServersTestJSON-1225512574 tempest-DeleteServersTestJSON-1225512574-project-member] Lock "dd9243d7-a43b-46d4-a669-ab1ff5460a7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.282s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-77b198a8-011a-49f6-ac2a-0c2185b4dbe6 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.944s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:58:19 user nova-compute[74903]: INFO nova.compute.claims [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Claim successful on node user
Nov 06 05:58:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:20 user nova-compute[74903]: INFO nova.compute.manager [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Detaching volume ae0dfe4e-35b6-4366-a592-12b332a3aef2
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:58:20 user nova-compute[74903]: INFO nova.virt.block_device [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Attempting to driver detach volume ae0dfe4e-35b6-4366-a592-12b332a3aef2 from mountpoint /dev/sdc
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Attempting to detach device sdc from instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 05:58:20 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:20 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 05:58:20 user nova-compute[74903]:   <target dev="sdc" bus="scsi"/>
Nov 06 05:58:20 user nova-compute[74903]:   <serial>ae0dfe4e-35b6-4366-a592-12b332a3aef2</serial>
Nov 06 05:58:20 user nova-compute[74903]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 05:58:20 user nova-compute[74903]: </disk>
Nov 06 05:58:20 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 05:58:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Successfully detached device sdc from instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 from the persistent domain config.
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 05:58:20 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:20 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 05:58:20 user nova-compute[74903]:   <target dev="sdc" bus="scsi"/>
Nov 06 05:58:20 user nova-compute[74903]:   <serial>ae0dfe4e-35b6-4366-a592-12b332a3aef2</serial>
Nov 06 05:58:20 user nova-compute[74903]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 05:58:20 user nova-compute[74903]: </disk>
Nov 06 05:58:20 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:58:20 user nova-compute[74903]: INFO nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Booting with volume 36ab9587-36a8-43b3-8a92-a64dce74eeb8 at /dev/vda
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.policy [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35c7b2dde4a64ce3a23a67df5423a16e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1cb0f6959fa4b9e869f688933b80d82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257f8de-5da9-4871-9439-61e98e0f3344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78f75d-02db-49f5-b0c8-40ea6edf2245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9636e6-88c6-44ba-8788-5c203ce9a8a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac675f39-44de-43d7-b50b-19d7b47d11ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:20 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:58:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[666db5b8-b6be-4f60-bda5-cb44d9ec9bdd]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating existing volume attachment record: e2af4098-2788-4b51-b65e-33a79330b7e3 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully created port: 41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully created port: 734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully created port: b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully created port: d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully created port: f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:58:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: 41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-41646a38-a4db-4ca6-bf7e-1dc23226895f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port 41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-419bba42-0f46-4854-a343-b8da8c9d46ee req-2ef1f2a3-73ed-4f50-83d8-2dee1502fe00 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:25 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: 0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-bf7ef72e-bf3a-47df-894a-2fcab391d313. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: 734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-0c3693dc-a0af-46af-9b72-68ecc6d5254d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port 0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc24c4e0-2265-4719-8628-e91bc81be4ae req-923d6de6-69b0-4662-b7f6-fb419ba470e8 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-734d3dde-050e-4cb9-85f2-c01641898cdb. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port 734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Successfully updated port: f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-d6e82787-dae3-4353-8541-ce24b080e154. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-facad717-9fb8-4320-8b7e-ec55349eb14e req-9c19eefe-279c-4e75-ace1-d4376d535122 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:58:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-f882adc1-0815-4977-9b82-bcfbb03ce30b. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance network_info: |[{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:58:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:58:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updated VIF entry in instance network info cache for port f882adc1-0815-4977-9b82-bcfbb03ce30b. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:58:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4179d989-5112-4121-bedd-e04f3e2603cf req-f4a926e7-5eef-41f3-9a23-928407add92b service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:58:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Creating image(s)
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Ensure instance console log exists: /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Start _get_guest_xml network_info=[{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgjXFnRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce617b70-08a4-492d-a9ec-138cc4990e20', 'attached_at': '', 'detached_at': '', 'volume_id': '72628c58-0835-4652-a5c3-482eb93aab93', 'serial': '72628c58-0835-4652-a5c3-482eb93aab93'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'c84e1b15-e7f2-4f91-96c0-cb254eab2854', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGEZBVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce617b70-08a4-492d-a9ec-138cc4990e20', 'attached_at': '', 'detached_at': '', 'volume_id': '256c316a-b692-43fe-a01b-081cb29dbe46', 'serial': '256c316a-b692-43fe-a01b-081cb29dbe46'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '7748a4f3-d7ef-4aaf-aa4e-b0296670e3d7', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKIHPWpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce617b70-08a4-492d-a9ec-138cc4990e20', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8e855e8-844a-451b-ad93-d91d4e30a669', 'serial': 'c8e855e8-844a-451b-ad93-d91d4e30a669'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': 'd5214da4-dab4-4d97-86eb-92971b6a75e5', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:58:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:58:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgjXFnRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:34 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:34 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:34 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5aea6c-ab35-4063-afc4-52d110288086]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:58:34 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de6d7d7-5114-4e7c-936d-b2d14581a1ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93] added
Nov 06 05:58:34 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33129c7-fc23-48e0-a21f-2440282d904f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfcd0a9-f3ac-422c-bd21-35b4cd1305f6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgjXFnRJ {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UgjXFnRJ" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d95a65-e8c8-4c2e-b007-a92e1e63697a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UgjXFnRJ'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d45215-7325-4b60-96c4-b6aef10ddc5d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751cd7d-b9be-4771-b115-29855bf386d4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:34 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:34 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e059daa-b12e-430b-8a59-188e79b7e8de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260]
Nov 06 05:58:35 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[add02c48-25d5-460e-903e-9b372a611823]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a1459-c053-467b-8389-c7b642fef9e1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:35 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:35 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[157e5def-9b9b-4324-bfd0-e8b892a58fe3]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgjXFnRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 05:58:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23431313639323137', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431313639323137', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGEZBVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:36 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:36 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:36 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61ef58-253c-4399-9e17-e1c6b34e5cab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:58:36 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa66f7fd-3464-42c2-a8de-d6bece192dfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46] added
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988fe9c-325f-4ec7-b682-a66402562aaa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9bb6d-43d7-4911-88b2-521c494eb2f8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGEZBVmd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MGEZBVmd" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf940b-864e-4a78-b65b-d9a189d17890]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MGEZBVmd'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee300b4-b25e-4cdb-a6cf-d13f285ae3c6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c3049-55f2-47c8-97fb-40997e9c0837]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[278359f8-8268-4b44-891c-9a1966be59d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260]
Nov 06 05:58:36 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1496d1-ab4f-4b15-8047-657e4a298e8c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf15eac5-811e-41bf-ac3d-d27935b91501]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:36 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6a5f5-65d9-4b0a-9e37-136263af0151]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGEZBVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23132623265313334', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132623265313334', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKIHPWpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:37 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:37 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:37 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac27884-62e4-4dce-af15-0d8a383f8b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:58:37 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d8e17-3216-48ce-84c5-966f87392dc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669] added
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[49472f43-40c0-4f9c-bd22-97630e5c6fe9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39cce24-3851-4ad5-9f3b-e6187a9ee07d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKIHPWpY {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKIHPWpY" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875f2dc-7f8e-4b0c-b200-eccb97d594a2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QKIHPWpY'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2908edc7-25a4-4093-bbce-d971050a7c4a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4218130-fc56-4af7-ac54-035e7da9d85b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f56d69-39d1-4721-ae12-5154b36b4d43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260]
Nov 06 05:58:37 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15be112-116e-4e72-b91a-10ebe483ed9f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[174dedcb-32d3-42bf-8540-ffacf98bacf7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57380cc-67ca-439a-b1de-aff7774b2f89]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKIHPWpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26434353261616462', 'path': '/dev/sde'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434353261616462', 'path': '/dev/sde'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.objects.instance [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lazy-loading 'pci_devices' on Instance uuid ce617b70-08a4-492d-a9ec-138cc4990e20 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:58:38 user nova-compute[74903]:   <uuid>ce617b70-08a4-492d-a9ec-138cc4990e20</uuid>
Nov 06 05:58:38 user nova-compute[74903]:   <name>instance-0000000b</name>
Nov 06 05:58:38 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:58:38 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:58:38 user nova-compute[74903]:   <metadata>
Nov 06 05:58:38 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:58:38 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:name>tempest-device-tagging-server-152320898</nova:name>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:58:34</nova:creationTime>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:58:38 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:58:38 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:owner>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:user uuid="b54e5d18967a4c71ad0a6d74a6d4fbcc">tempest-TaggedBootDevicesTest-1794490616-project-member</nova:user>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:project uuid="74bd8bf20dc14f17b2af834a5fa96602">tempest-TaggedBootDevicesTest-1794490616</nova:project>
Nov 06 05:58:38 user nova-compute[74903]:       </nova:owner>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:58:38 user nova-compute[74903]:       <nova:ports>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="1843bb97-2178-4df3-aa6a-d6472964d761">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="d0742d33-c506-49a8-8629-5d4ca630014e">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.121" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="e0024f2e-1da9-4744-a3f9-d6805bbe8657">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="073f527c-ea48-488a-bc51-56124b43fa5d">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="65a5dea2-48f7-455b-9cd8-9f08ca8244a9">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="20a57265-77dc-4c93-8c3a-b1055941b513">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:         <nova:port uuid="dfe77107-4f8c-445b-afd3-417b8de17897">
Nov 06 05:58:38 user nova-compute[74903]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 05:58:38 user nova-compute[74903]:         </nova:port>
Nov 06 05:58:38 user nova-compute[74903]:       </nova:ports>
Nov 06 05:58:38 user nova-compute[74903]:     </nova:instance>
Nov 06 05:58:38 user nova-compute[74903]:   </metadata>
Nov 06 05:58:38 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:58:38 user nova-compute[74903]:     <system>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="serial">ce617b70-08a4-492d-a9ec-138cc4990e20</entry>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="uuid">ce617b70-08a4-492d-a9ec-138cc4990e20</entry>
Nov 06 05:58:38 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:58:38 user nova-compute[74903]:     </system>
Nov 06 05:58:38 user nova-compute[74903]:   </sysinfo>
Nov 06 05:58:38 user nova-compute[74903]:   <os>
Nov 06 05:58:38 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:58:38 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:58:38 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:58:38 user nova-compute[74903]:   </os>
Nov 06 05:58:38 user nova-compute[74903]:   <features>
Nov 06 05:58:38 user nova-compute[74903]:     <acpi/>
Nov 06 05:58:38 user nova-compute[74903]:     <apic/>
Nov 06 05:58:38 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:58:38 user nova-compute[74903]:   </features>
Nov 06 05:58:38 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:58:38 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:58:38 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:58:38 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:58:38 user nova-compute[74903]:   </clock>
Nov 06 05:58:38 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:58:38 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:58:38 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:58:38 user nova-compute[74903]:   </cpu>
Nov 06 05:58:38 user nova-compute[74903]:   <devices>
Nov 06 05:58:38 user nova-compute[74903]:     <disk type="file" device="cdrom">
Nov 06 05:58:38 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 05:58:38 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/disk.config"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="hda" bus="ide"/>
Nov 06 05:58:38 user nova-compute[74903]:     </disk>
Nov 06 05:58:38 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:58:38 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:38 user nova-compute[74903]:       <source dev="/dev/sdc"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <serial>72628c58-0835-4652-a5c3-482eb93aab93</serial>
Nov 06 05:58:38 user nova-compute[74903]:     </disk>
Nov 06 05:58:38 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:58:38 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:38 user nova-compute[74903]:       <source dev="/dev/sdd"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <serial>256c316a-b692-43fe-a01b-081cb29dbe46</serial>
Nov 06 05:58:38 user nova-compute[74903]:     </disk>
Nov 06 05:58:38 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:58:38 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:38 user nova-compute[74903]:       <source dev="/dev/sde"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="vdc" bus="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <serial>c8e855e8-844a-451b-ad93-d91d4e30a669</serial>
Nov 06 05:58:38 user nova-compute[74903]:     </disk>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:6b:63:ed"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tap1843bb97-21"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:68:17:43"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tapd0742d33-c5"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:07:dc:f5"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tape0024f2e-1d"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:1e:18:aa"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tap073f527c-ea"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:09:b7:25"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tap65a5dea2-48"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:c6:26:1a"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tap20a57265-77"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:58:38 user nova-compute[74903]:       <mac address="fa:16:3e:f6:38:ff"/>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:58:38 user nova-compute[74903]:       <target dev="tapdfe77107-4f"/>
Nov 06 05:58:38 user nova-compute[74903]:     </interface>
Nov 06 05:58:38 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:58:38 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/console.log" append="off"/>
Nov 06 05:58:38 user nova-compute[74903]:     </serial>
Nov 06 05:58:38 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:58:38 user nova-compute[74903]:     <video>
Nov 06 05:58:38 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:58:38 user nova-compute[74903]:     </video>
Nov 06 05:58:38 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:58:38 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:58:38 user nova-compute[74903]:     </rng>
Nov 06 05:58:38 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:58:38 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:58:38 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:58:38 user nova-compute[74903]:     </memballoon>
Nov 06 05:58:38 user nova-compute[74903]:   </devices>
Nov 06 05:58:38 user nova-compute[74903]: </domain>
Nov 06 05:58:38 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85a45352-32a7-5e3c-b78f-cd220e8a79be', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1843bb97-21, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1843bb97-21, col_values=(('qos', UUID('0e8b588e-77b6-49b2-b9ce-c03b3fbb2b5e')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1843bb97-21, col_values=(('external_ids', {'iface-id': '1843bb97-2178-4df3-aa6a-d6472964d761', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:63:ed', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21')
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf054da2-703c-55d5-8d75-3b66d2c52152', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0742d33-c5, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0742d33-c5, col_values=(('qos', UUID('62abcee5-05f4-4f9b-bcfd-725b59bb709b')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0742d33-c5, col_values=(('external_ids', {'iface-id': 'd0742d33-c506-49a8-8629-5d4ca630014e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:17:43', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9423e103-cdee-5478-a9e6-ff7ae98a778f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0024f2e-1d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0024f2e-1d, col_values=(('qos', UUID('6bb30efc-ed2f-41ee-bcd8-8be2ad3332a8')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0024f2e-1d, col_values=(('external_ids', {'iface-id': 'e0024f2e-1da9-4744-a3f9-d6805bbe8657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:dc:f5', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62c0e2d3-9b76-54b5-b896-766b6e20e001', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073f527c-ea, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap073f527c-ea, col_values=(('qos', UUID('5935a5b3-5958-4065-98a0-e48b42120283')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap073f527c-ea, col_values=(('external_ids', {'iface-id': '073f527c-ea48-488a-bc51-56124b43fa5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:18:aa', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e665919-85fa-503e-b29a-2fc1b25ce00f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65a5dea2-48, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65a5dea2-48, col_values=(('qos', UUID('721f6c9d-c24e-4830-8e74-043ca531c4de')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65a5dea2-48, col_values=(('external_ids', {'iface-id': '65a5dea2-48f7-455b-9cd8-9f08ca8244a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:b7:25', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1df00d7-3af1-5cb2-90b1-b955ec55a07b', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20a57265-77, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20a57265-77, col_values=(('qos', UUID('484ee5c6-ddaa-4645-bdf7-624977efa63a')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20a57265-77, col_values=(('external_ids', {'iface-id': '20a57265-77dc-4c93-8c3a-b1055941b513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:26:1a', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dc99aee-96d3-5653-8a62-10d25fcb3679', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfe77107-4f, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfe77107-4f, col_values=(('qos', UUID('9a5cfebb-411e-4b7d-9f01-6eb3781fe588')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfe77107-4f, col_values=(('external_ids', {'iface-id': 'dfe77107-4f8c-445b-afd3-417b8de17897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:38:ff', 'vm-uuid': 'ce617b70-08a4-492d-a9ec-138cc4990e20'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:39 user nova-compute[74903]: INFO os_vif [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f')
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] No BDM found with device name hda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] No VIF found with MAC fa:16:3e:6b:63:ed, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] No VIF found with MAC fa:16:3e:09:b7:25, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:58:39 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Using config drive
Nov 06 05:58:39 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Creating config drive at /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/disk.config
Nov 06 05:58:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjuzhq1lh {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjuzhq1lh" returned: 0 in 0.055s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfOwmHvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:40 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a533fca-0257-4072-94cb-340c24b93c1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:58:40 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18bc16-b060-4167-b0f5-1bad0cc0d474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb] added
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f566a7e-6b6c-429a-a5d3-cc295ceaf6f6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1462a6-39a7-4aa9-a8ab-770ba64b3d43]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfOwmHvu {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfOwmHvu" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3ddd0c-7fe5-48d0-8f46-1a3b720e7a4c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfOwmHvu'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eeaab5-3554-472c-ac65-decb1e5d17ae]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841d2a1-bf14-45c2-98ed-5f254493344d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0e7d27-032c-428a-becb-a935f47489b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260]
Nov 06 05:58:40 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f5966e-81de-4f00-98d9-80a7ff3d9f2b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b486899f-e533-4a9a-b79b-74bfcace5a58]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:40 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:58:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2371aa-d8e7-49c6-85d4-bfa002cd4ab9]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 is timed out.
Nov 06 05:58:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Successfully detached device sdc from instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 from the live domain config.
Nov 06 05:58:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUXhfbZd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:58:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfOwmHvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23562626436393365', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562626436393365', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.426s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.objects.instance [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lazy-loading 'flavor' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0914d3d1-3100-4ea6-873a-1c971a28252d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 05:58:41 user nova-compute[74903]: No targets found.
Nov 06 05:58:41 user nova-compute[74903]: iSNS:
Nov 06 05:58:41 user nova-compute[74903]: No targets found.
Nov 06 05:58:41 user nova-compute[74903]: STATIC:
Nov 06 05:58:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93
Nov 06 05:58:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669
Nov 06 05:58:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46
Nov 06 05:58:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb
Nov 06 05:58:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2
Nov 06 05:58:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:58:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:58:41 user nova-compute[74903]: FIRMWARE:
Nov 06 05:58:41 user nova-compute[74903]: No targets found.
Nov 06 05:58:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 05:58:41 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 05:58:41 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f9b216-aa19-41c2-8f8f-bf06aa378d46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a953b1-39ba-4ad4-b00e-8cee47604abf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:58:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:58:41 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:58:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4028c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] attach device xml: <disk type="block" device="disk">
Nov 06 05:58:41 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:41 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 05:58:41 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 05:58:41 user nova-compute[74903]:   <serial>d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb</serial>
Nov 06 05:58:41 user nova-compute[74903]: </disk>
Nov 06 05:58:41 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bda2964-8242-4bd7-8b9c-eb71fa38ec4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc36692-d8e5-43d8-9cb4-d673b282fffc]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd31ed8-7bd7-454f-8842-3c4ef1598d8b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.079s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ca2cd-cb72-4597-ab44-e82b256ff500]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[69872820-77f4-4f26-a709-01079ee24352]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:41 user nova-compute[74903]: WARNING nova.compute.manager [req-6db9e631-0985-41a1-b740-1508b3be4676 req-ada75edf-e9a3-4c0c-abd0-396639a329d4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 for instance with vm_state building and task_state spawning.
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.129s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec4562b-f5db-4a07-98b5-bc0029b622f5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260]
Nov 06 05:58:41 user nova-compute[74903]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2, portal: 172.16.0.220,3260] successful.
Nov 06 05:58:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae0dfe4e-35b6-4366-a592-12b332a3aef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc76af51-c407-4a05-ac31-df4006c5a028]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] <== disconnect_volume: return (885ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] No VIF found with MAC fa:16:3e:da:cc:f5, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:42 user nova-compute[74903]: WARNING nova.compute.manager [req-f732a548-4983-4146-9245-d95ae00ccce7 req-5f42a10d-14ce-4904-a550-3d3591169357 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e for instance with vm_state building and task_state spawning.
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lazy-loading 'flavor' on Instance uuid 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef70f0fe-c24b-4f1d-8409-3b09128e7d91 tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.872s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-abcb301a-978f-478e-8189-6de45e57de41 tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.278s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:43 user nova-compute[74903]: WARNING nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 for instance with vm_state building and task_state spawning.
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:43 user nova-compute[74903]: WARNING nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 for instance with vm_state building and task_state spawning.
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:43 user nova-compute[74903]: WARNING nova.compute.manager [req-2fb236a3-c0b0-49c3-a3b8-e188324a2c8c req-6b011572-5fc3-4484-9ab2-a07fc5dd23ad service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 for instance with vm_state building and task_state spawning.
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] volume_snapshot_create: create_info: {'snapshot_id': '994bed57-ad40-464b-928c-79ed75963c95', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74903) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] snap xml: <domainsnapshot>
Nov 06 05:58:44 user nova-compute[74903]:   <disks>
Nov 06 05:58:44 user nova-compute[74903]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 06 05:58:44 user nova-compute[74903]:       <source file="/dev/new_file"/>
Nov 06 05:58:44 user nova-compute[74903]:     </disk>
Nov 06 05:58:44 user nova-compute[74903]:     <disk name="vda" snapshot="no"/>
Nov 06 05:58:44 user nova-compute[74903]:   </disks>
Nov 06 05:58:44 user nova-compute[74903]: </domainsnapshot>
Nov 06 05:58:44 user nova-compute[74903]:  {{(pid=74903) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] Lazy-loading 'system_metadata' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: INFO nova.compute.manager [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Terminating instance
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c6159803-bf0f-48c8-b439-36fbad7d3fa0 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] volume_snapshot_delete: delete_info: {'volume_id': 'd4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb'} {{(pid=74903) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [None req-c6159803-bf0f-48c8-b439-36fbad7d3fa0 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     if delete_info['type'] != 'qcow2':
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] KeyError: 'type'
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     rv = execute(f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     six.reraise(c, e, tb)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     raise value
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     rv = meth(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     self._volume_snapshot_create(context, instance, guest,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     rv = execute(f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     six.reraise(c, e, tb)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     raise value
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     rv = meth(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] 
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [None req-c6159803-bf0f-48c8-b439-36fbad7d3fa0 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6c8422d5-4aa1-4902-8b34-f0fa4288645f)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server [None req-c6159803-bf0f-48c8-b439-36fbad7d3fa0 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] Exception during message handling: KeyError: 'type'
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server 
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:44 user nova-compute[74903]: WARNING nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e for instance with vm_state building and task_state spawning.
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:44 user nova-compute[74903]: WARNING nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d for instance with vm_state building and task_state spawning.
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:44 user nova-compute[74903]: WARNING nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d for instance with vm_state building and task_state spawning.
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:44 user nova-compute[74903]: WARNING nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 for instance with vm_state building and task_state spawning.
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:44 user nova-compute[74903]: WARNING nova.compute.manager [req-88ba7188-da06-4cc8-8151-3e9b96071f1d req-30bd4198-86ff-4927-9e46-0445b4dfef38 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 for instance with vm_state building and task_state spawning.
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 994bed57-ad40-464b-928c-79ed75963c95 could not be found.
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise value
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 994bed57-ad40-464b-928c-79ed75963c95 could not be found. (HTTP 404) (Request-ID: req-d21b43e8-2989-4d4a-9356-583c2422a922)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 994bed57-ad40-464b-928c-79ed75963c95 could not be found.
Nov 06 05:58:44 user nova-compute[74903]: ERROR nova.virt.libvirt.driver 
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server [None req-1c31bfd2-1a63-453b-ab85-11d8670a8e53 tempest-VolumesAssistedSnapshotsTest-412115286 tempest-VolumesAssistedSnapshotsTest-412115286-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise value
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 05:58:44 user nova-compute[74903]: ERROR oslo_messaging.rpc.server 
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:44 user nova-compute[74903]: INFO nova.compute.manager [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Detaching volume d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Instance destroyed successfully.
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lazy-loading 'resources' on Instance uuid 814088c5-7ba1-4596-9a8d-8135ab4b8668 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1766771039',display_name='tempest-AttachSCSIVolumeTestJSON-server-1766771039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1766771039',id=7,image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2AOR2Tp/O5BLjibMnIln4FTdU8REBadv9vPGpIUv624yN95Xq+whMIx+XSWv+b/nXhPg2NH/I4X74NhEtsRTRw8zFUGXZsb0aC+xkNiDv56dSPUibWAhVJebT3r98NyQ==',key_name='tempest-keypair-189084297',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9f23457df2a4f07911c88a4d6bf2f02',ramdisk_id='',reservation_id='r-n1brltt9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94c412da-9ff7-4321-9bcc-c3d85234cb4a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1938999723',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1938999723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:55:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8990e94a694448a7bd21663308e81e36',uuid=814088c5-7ba1-4596-9a8d-8135ab4b8668,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converting VIF {"id": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "address": "fa:16:3e:9d:37:6b", "network": {"id": "f95adf2a-d540-4376-bbdf-71c67d923f65", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-95661600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9f23457df2a4f07911c88a4d6bf2f02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98b72f04-2d", "ovs_interfaceid": "98b72f04-2d16-44fb-af90-ac3ba4aec556", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_vif [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98b72f04-2d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.virt.block_device [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Attempting to driver detach volume d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb from mountpoint /dev/vdb
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32b1a161-bb3d-4529-9fe9-02dfdc7fac7b) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:58:45 user nova-compute[74903]: INFO os_vif [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:37:6b,bridge_name='br-int',has_traffic_filtering=True,id=98b72f04-2d16-44fb-af90-ac3ba4aec556,network=Network(f95adf2a-d540-4376-bbdf-71c67d923f65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98b72f04-2d')
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Deleting instance files /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668_del
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Deletion of /opt/stack/data/nova/instances/814088c5-7ba1-4596-9a8d-8135ab4b8668_del complete
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Attempting to detach device vdb from instance c6a9cf35-00cf-45b9-8727-267f150024a9 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 05:58:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:45 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 05:58:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 05:58:45 user nova-compute[74903]:   <serial>d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb</serial>
Nov 06 05:58:45 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 05:58:45 user nova-compute[74903]: </disk>
Nov 06 05:58:45 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Successfully detached device vdb from instance c6a9cf35-00cf-45b9-8727-267f150024a9 from the persistent domain config.
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6a9cf35-00cf-45b9-8727-267f150024a9 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 05:58:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:58:45 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 05:58:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 05:58:45 user nova-compute[74903]:   <serial>d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb</serial>
Nov 06 05:58:45 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 05:58:45 user nova-compute[74903]: </disk>
Nov 06 05:58:45 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.utils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b96149-d3e0-4cb4-b385-1e0f089d3e80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ad8ba1-1e83-4dba-bdd7-52c02b9f95db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:45 user nova-compute[74903]: INFO nova.compute.manager [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3420adde-f686-48ab-81ed-12d79d94bbe3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae2a14f-9487-46fe-80d6-ce089f3f510d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:45 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:58:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa104dff-1cc0-4cdf-8aa8-c4a794996cbc]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG os_brick.utils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating existing volume attachment record: dc54d898-b2f6-435c-9737-dc97d597088e {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:46 user nova-compute[74903]: INFO nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Booting with volume be243b7c-c47d-448f-bf28-3732328c00c6 at /dev/vdb
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a87ee-af8a-4018-aabd-f7dd9b5e8be0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 for instance with vm_state building and task_state spawning.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 for instance with vm_state building and task_state spawning.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 for instance with vm_state building and task_state spawning.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 for instance with vm_state building and task_state spawning.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state active and task_state deleting.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state active and task_state deleting.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state active and task_state deleting.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-unplugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Acquiring lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] No waiting events found dispatching network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING nova.compute.manager [req-8850f0c1-1412-4e6d-a469-9b0fd971394f req-00ad54d3-0a9d-4288-8c62-7b2e5a035499 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received unexpected event network-vif-plugged-98b72f04-2d16-44fb-af90-ac3ba4aec556 for instance with vm_state active and task_state deleting.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7f809-7224-4f47-8c04-92f5d740c903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad3f93-0b60-4c08-984b-37059500c22c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6a214-35b5-4f47-b916-21ab1ec95094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:58:46 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b142e-884e-48ff-b30b-282adf48ab54]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating existing volume attachment record: 72b7feab-ae37-43ec-ab0e-31ba7d4ee011 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-7abd91df-f1b5-4d97-a420-cdad5f240254 req-bc7d5d09-a17b-48a8-84ce-c0771652ea21 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Received event network-vif-deleted-98b72f04-2d16-44fb-af90-ac3ba4aec556 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:46 user nova-compute[74903]: INFO nova.compute.manager [req-7abd91df-f1b5-4d97-a420-cdad5f240254 req-bc7d5d09-a17b-48a8-84ce-c0771652ea21 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Neutron deleted interface 98b72f04-2d16-44fb-af90-ac3ba4aec556; detaching it from the instance and deleting it from the info cache
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-7abd91df-f1b5-4d97-a420-cdad5f240254 req-bc7d5d09-a17b-48a8-84ce-c0771652ea21 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:46 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Took 1.57 seconds to deallocate network for instance.
Nov 06 05:58:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-7abd91df-f1b5-4d97-a420-cdad5f240254 req-bc7d5d09-a17b-48a8-84ce-c0771652ea21 service nova] [instance: 814088c5-7ba1-4596-9a8d-8135ab4b8668] Detach interface failed, port_id=98b72f04-2d16-44fb-af90-ac3ba4aec556, reason: Instance 814088c5-7ba1-4596-9a8d-8135ab4b8668 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:58:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance spawned successfully.
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:58:47 user nova-compute[74903]: INFO nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Took 12.65 seconds to spawn the instance on the hypervisor.
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:58:47 user nova-compute[74903]: INFO nova.compute.manager [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Took 90.00 seconds to build instance.
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-259baa86-b137-40b5-9afa-39a5050699d4 tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.105s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:47 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Deleted allocations for instance 814088c5-7ba1-4596-9a8d-8135ab4b8668
Nov 06 05:58:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8f9c135b-a3eb-4785-a7ec-5beb5bf089db tempest-AttachSCSIVolumeTestJSON-1938999723 tempest-AttachSCSIVolumeTestJSON-1938999723-project-member] Lock "814088c5-7ba1-4596-9a8d-8135ab4b8668" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.626s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:49 user nova-compute[74903]: INFO nova.compute.manager [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Terminating instance
Nov 06 05:58:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-unplugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] No waiting events found dispatching network-vif-unplugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-f7317fda-1eaa-449d-86ef-7690cc3a495a req-dc0fdc20-2296-46fe-881a-9c50ccd4ecdb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-unplugged-fd522096-8e16-4931-84c1-839188a751f8 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Instance destroyed successfully.
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lazy-loading 'resources' on Instance uuid 9dc53b4e-ca95-4225-abf2-c48fa3880cf1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1528741194',display_name='tempest-ServersNegativeTestJSON-server-1528741194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1528741194',id=10,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:57:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-dv8bgyc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:57:09Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=9dc53b4e-ca95-4225-abf2-c48fa3880cf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "fd522096-8e16-4931-84c1-839188a751f8", "address": "fa:16:3e:a0:6a:71", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd522096-8e", "ovs_interfaceid": "fd522096-8e16-4931-84c1-839188a751f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG os_vif [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd522096-8e, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d9613bb-7be8-4867-9f82-71bd4dea6a4d) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:58:50 user nova-compute[74903]: INFO os_vif [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:6a:71,bridge_name='br-int',has_traffic_filtering=True,id=fd522096-8e16-4931-84c1-839188a751f8,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd522096-8e')
Nov 06 05:58:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Deleting instance files /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1_del
Nov 06 05:58:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Deletion of /opt/stack/data/nova/instances/9dc53b4e-ca95-4225-abf2-c48fa3880cf1_del complete
Nov 06 05:58:50 user nova-compute[74903]: INFO nova.compute.manager [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 06 05:58:50 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 05:58:50 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 05:58:51 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-ffc39a21-0017-490c-b122-2826dfb25f49 req-914e2899-d3da-4db8-9edf-ee5442fb12b0 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-deleted-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:51 user nova-compute[74903]: INFO nova.compute.manager [req-ffc39a21-0017-490c-b122-2826dfb25f49 req-914e2899-d3da-4db8-9edf-ee5442fb12b0 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Neutron deleted interface fd522096-8e16-4931-84c1-839188a751f8; detaching it from the instance and deleting it from the info cache
Nov 06 05:58:51 user nova-compute[74903]: DEBUG nova.network.neutron [req-ffc39a21-0017-490c-b122-2826dfb25f49 req-914e2899-d3da-4db8-9edf-ee5442fb12b0 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:58:51 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Took 0.60 seconds to deallocate network for instance.
Nov 06 05:58:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-ffc39a21-0017-490c-b122-2826dfb25f49 req-914e2899-d3da-4db8-9edf-ee5442fb12b0 service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Detach interface failed, port_id=fd522096-8e16-4931-84c1-839188a751f8, reason: Instance 9dc53b4e-ca95-4225-abf2-c48fa3880cf1 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 05:58:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:52 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Deleted allocations for instance 9dc53b4e-ca95-4225-abf2-c48fa3880cf1
Nov 06 05:58:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-736a6aaa-84cd-4cd1-9783-4090565d699b tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.345s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] Acquiring lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] Lock "9dc53b4e-ca95-4225-abf2-c48fa3880cf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:58:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] No waiting events found dispatching network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:58:52 user nova-compute[74903]: WARNING nova.compute.manager [req-c32584e7-0da4-4ee0-8f0c-837cd832f341 req-a564bcef-7cbb-4785-948f-0370e40cf6fb service nova] [instance: 9dc53b4e-ca95-4225-abf2-c48fa3880cf1] Received unexpected event network-vif-plugged-fd522096-8e16-4931-84c1-839188a751f8 for instance with vm_state deleted and task_state None.
Nov 06 05:58:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 05:59:02 user nova-compute[74903]: INFO nova.compute.claims [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Claim successful on node user
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 05:59:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.policy [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44c3df905516436e8a6c39e0f32a2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b574412f0d4156a9d4538b17b2c163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:59:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Creating image(s)
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk 1073741824" returned: 0 in 0.059s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Successfully created port: 9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Cannot resize image /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Ensure instance console log exists: /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:04 user nova-compute[74903]: INFO nova.compute.manager [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Terminating instance
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Successfully updated port: 9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-changed-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Refreshing instance network info cache due to event network-changed-9033c9b3-0dba-4b46-bea3-5a3b0bf02649. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] Acquiring lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-unplugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] No waiting events found dispatching network-vif-unplugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-07b110aa-7f6b-446d-b9a8-59782a1213aa req-798c3d70-7d7d-49aa-8511-b66608a4a19d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-unplugged-164f4823-bf57-4d2b-aac1-eb10b96a169d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.neutron [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating instance_info_cache with network_info: [{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance network_info: |[{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] Acquired lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Refreshing network info cache for port 9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start _get_guest_xml network_info=[{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:59:05 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:05 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-tempest.common.compute-instance-111030931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.objects.instance [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'pci_devices' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:59:05 user nova-compute[74903]:   <uuid>dee138d4-059b-489d-8122-cbb4b2c2112e</uuid>
Nov 06 05:59:05 user nova-compute[74903]:   <name>instance-0000000f</name>
Nov 06 05:59:05 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:59:05 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:59:05 user nova-compute[74903]:   <metadata>
Nov 06 05:59:05 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:59:05 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:name>tempest-tempest.common.compute-instance-111030931</nova:name>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:59:05</nova:creationTime>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:59:05 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:59:05 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:owner>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:user uuid="44c3df905516436e8a6c39e0f32a2e4b">tempest-ServerActionsTestOtherA-851074598-project-member</nova:user>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:project uuid="29b574412f0d4156a9d4538b17b2c163">tempest-ServerActionsTestOtherA-851074598</nova:project>
Nov 06 05:59:05 user nova-compute[74903]:       </nova:owner>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:59:05 user nova-compute[74903]:       <nova:ports>
Nov 06 05:59:05 user nova-compute[74903]:         <nova:port uuid="9033c9b3-0dba-4b46-bea3-5a3b0bf02649">
Nov 06 05:59:05 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 05:59:05 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:05 user nova-compute[74903]:       </nova:ports>
Nov 06 05:59:05 user nova-compute[74903]:     </nova:instance>
Nov 06 05:59:05 user nova-compute[74903]:   </metadata>
Nov 06 05:59:05 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:59:05 user nova-compute[74903]:     <system>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="serial">dee138d4-059b-489d-8122-cbb4b2c2112e</entry>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="uuid">dee138d4-059b-489d-8122-cbb4b2c2112e</entry>
Nov 06 05:59:05 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:59:05 user nova-compute[74903]:     </system>
Nov 06 05:59:05 user nova-compute[74903]:   </sysinfo>
Nov 06 05:59:05 user nova-compute[74903]:   <os>
Nov 06 05:59:05 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:59:05 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:59:05 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:59:05 user nova-compute[74903]:   </os>
Nov 06 05:59:05 user nova-compute[74903]:   <features>
Nov 06 05:59:05 user nova-compute[74903]:     <acpi/>
Nov 06 05:59:05 user nova-compute[74903]:     <apic/>
Nov 06 05:59:05 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:59:05 user nova-compute[74903]:   </features>
Nov 06 05:59:05 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:59:05 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:59:05 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:59:05 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:59:05 user nova-compute[74903]:   </clock>
Nov 06 05:59:05 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:59:05 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:59:05 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:59:05 user nova-compute[74903]:   </cpu>
Nov 06 05:59:05 user nova-compute[74903]:   <devices>
Nov 06 05:59:05 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 05:59:05 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 05:59:05 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk"/>
Nov 06 05:59:05 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:59:05 user nova-compute[74903]:     </disk>
Nov 06 05:59:05 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:05 user nova-compute[74903]:       <mac address="fa:16:3e:2f:b5:21"/>
Nov 06 05:59:05 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:05 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:05 user nova-compute[74903]:       <target dev="tap9033c9b3-0d"/>
Nov 06 05:59:05 user nova-compute[74903]:     </interface>
Nov 06 05:59:05 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:59:05 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/console.log" append="off"/>
Nov 06 05:59:05 user nova-compute[74903]:     </serial>
Nov 06 05:59:05 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:59:05 user nova-compute[74903]:     <video>
Nov 06 05:59:05 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:05 user nova-compute[74903]:     </video>
Nov 06 05:59:05 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:59:05 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:59:05 user nova-compute[74903]:     </rng>
Nov 06 05:59:05 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:59:05 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:59:05 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:59:05 user nova-compute[74903]:     </memballoon>
Nov 06 05:59:05 user nova-compute[74903]:   </devices>
Nov 06 05:59:05 user nova-compute[74903]: </domain>
Nov 06 05:59:05 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-tempest.common.compute-instance-111030931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_vif [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e0e2d71-accd-557f-aada-5ef4c4b708eb', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Instance destroyed successfully.
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lazy-loading 'resources' on Instance uuid f1ce6341-ad1a-4ca3-b86a-2ad850930b0f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9033c9b3-0d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9033c9b3-0d, col_values=(('qos', UUID('2b478f4e-b70b-4bd1-8fad-eaf88ea857ee')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9033c9b3-0d, col_values=(('external_ids', {'iface-id': '9033c9b3-0dba-4b46-bea3-5a3b0bf02649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:b5:21', 'vm-uuid': 'dee138d4-059b-489d-8122-cbb4b2c2112e'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:56:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1743869635',display_name='tempest-VolumesActionsTest-instance-1743869635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1743869635',id=9,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:56:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ae8f99d90874f88a339acdd652206cc',ramdisk_id='',reservation_id='r-q3tvc35u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-173659946',owner_user_name='tempest-VolumesActionsTest-173659946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:56:45Z,user_data=None,user_id='77957c731a3c4178bfe1983b7c8a8f1e',uuid=f1ce6341-ad1a-4ca3-b86a-2ad850930b0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converting VIF {"id": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "address": "fa:16:3e:23:ab:d8", "network": {"id": "6158c38a-11bb-490d-bb37-f72c2827097f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-181718570-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ae8f99d90874f88a339acdd652206cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164f4823-bf", "ovs_interfaceid": "164f4823-bf57-4d2b-aac1-eb10b96a169d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_vif [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: INFO os_vif [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d')
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap164f4823-bf, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3330781-71a0-4aa0-a347-050e13ddc9fe) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:05 user nova-compute[74903]: INFO os_vif [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ab:d8,bridge_name='br-int',has_traffic_filtering=True,id=164f4823-bf57-4d2b-aac1-eb10b96a169d,network=Network(6158c38a-11bb-490d-bb37-f72c2827097f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164f4823-bf')
Nov 06 05:59:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Deleting instance files /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f_del
Nov 06 05:59:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Deletion of /opt/stack/data/nova/instances/f1ce6341-ad1a-4ca3-b86a-2ad850930b0f_del complete
Nov 06 05:59:05 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6a9cf35-00cf-45b9-8727-267f150024a9 is timed out.
Nov 06 05:59:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Successfully detached device vdb from instance c6a9cf35-00cf-45b9-8727-267f150024a9 from the live domain config.
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfOwmHvu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:05 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:2f:b5:21, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5461c0d-97a5-4f67-ba4c-e55063188bad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 05:59:05 user nova-compute[74903]: No targets found.
Nov 06 05:59:05 user nova-compute[74903]: iSNS:
Nov 06 05:59:05 user nova-compute[74903]: No targets found.
Nov 06 05:59:05 user nova-compute[74903]: STATIC:
Nov 06 05:59:05 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93
Nov 06 05:59:05 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:59:05 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:59:05 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669
Nov 06 05:59:05 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:59:05 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:59:05 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46
Nov 06 05:59:05 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:59:05 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:59:05 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb
Nov 06 05:59:05 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 05:59:05 user nova-compute[74903]:                 Iface Name: default
Nov 06 05:59:05 user nova-compute[74903]: FIRMWARE:
Nov 06 05:59:05 user nova-compute[74903]: No targets found.
Nov 06 05:59:05 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 05:59:05 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 05:59:05 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f3cb8-ab00-40d5-afa1-b8663250bd3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: INFO nova.compute.manager [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee35346-401e-464e-be25-8892b5fd5878]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:59:05 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:05 user nova-compute[74903]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb (non-flash)
Nov 06 05:59:05 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa287b31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4516c6-7c7a-4d20-8e26-f12f115b74f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c41ba-2f21-49a9-84a8-51371cb887a0]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b25be-38ed-4275-a436-d2237a3a081a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 05:59:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf26e50-406a-40d9-b5d1-e35b6aa6938e]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f8e64-6b50-4378-89a2-393499b31a11]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35e87eb-7939-4dd8-b213-8d2b4118784c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260]
Nov 06 05:59:06 user nova-compute[74903]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb, portal: 172.16.0.220,3260] successful.
Nov 06 05:59:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updated VIF entry in instance network info cache for port 9033c9b3-0dba-4b46-bea3-5a3b0bf02649. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating instance_info_cache with network_info: [{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ad4ab8-16f4-476c-9c8a-9b362c3dc5fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3276b0-4430-4a8f-a9fd-a837e5f8b391]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] <== disconnect_volume: return (367ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34d89825-306d-4b7f-a405-f6da5358e49e req-6b0db7ab-e699-4823-b6d9-0bea1ae303f0 service nova] Releasing lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:06 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Took 0.89 seconds to deallocate network for instance.
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:59:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-d12f82f6-dd39-417d-a0b8-91a02ef1e03e req-0f9f1356-c025-4b0d-b74b-bdbc0cd7ae6b service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-deleted-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] Acquiring lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] No waiting events found dispatching network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:07 user nova-compute[74903]: WARNING nova.compute.manager [req-74a82830-486c-42ff-b9b4-576657998e45 req-a014cf9b-5563-40aa-9f38-f32a7108ed9d service nova] [instance: f1ce6341-ad1a-4ca3-b86a-2ad850930b0f] Received unexpected event network-vif-plugged-164f4823-bf57-4d2b-aac1-eb10b96a169d for instance with vm_state deleted and task_state None.
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.135s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 05:59:07 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Deleted allocations for instance f1ce6341-ad1a-4ca3-b86a-2ad850930b0f
Nov 06 05:59:07 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lazy-loading 'flavor' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8e6d7f4e-beb2-4ede-a72d-f50786261a1f tempest-VolumesAssistedSnapshotsTest-1752397761 tempest-VolumesAssistedSnapshotsTest-1752397761-project-admin] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.574s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4d3e3303-ad41-415a-813d-9baecba3fbf8 tempest-VolumesActionsTest-173659946 tempest-VolumesActionsTest-173659946-project-member] Lock "f1ce6341-ad1a-4ca3-b86a-2ad850930b0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:09 user nova-compute[74903]: WARNING nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state building and task_state spawning.
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:09 user nova-compute[74903]: WARNING nova.compute.manager [req-120d4da2-db3d-4322-a03a-72f031e70148 req-ca2b650f-e286-4782-9909-decdb02fce9b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state building and task_state spawning.
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:59:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance spawned successfully.
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:09 user nova-compute[74903]: INFO nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 06 05:59:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:09 user nova-compute[74903]: INFO nova.compute.manager [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Took 7.17 seconds to build instance.
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-00f65141-27ca-4a3d-95b7-13ff0acf800e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.319s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:59:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Creating image(s)
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Ensure instance console log exists: /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start _get_guest_xml network_info=[{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42720fc5-a750-4108-bd41-f8834bc4edee', 'attached_at': '', 'detached_at': '', 'volume_id': '5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'serial': '5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'dc54d898-b2f6-435c-9737-dc97d597088e', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:59:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:12 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:12 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:12 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4ae7ce-c2af-4f0d-b83e-445dd2b028c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:59:12 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b3889-39b0-4dae-ae53-fc1a642784d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a] added
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc77a8a-9e5c-4877-8d77-4d1864e90f1e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b41f6-7427-44fd-9ee1-f83f1150ad61]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEiDpIQd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEiDpIQd" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[803c521f-e461-4a92-b23b-bffc0187538a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GEiDpIQd'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf0ec53-f86b-46fa-a381-8b8f31f2d1ce]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[294209e1-ee57-4dc7-9225-b3e74cbb222b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[40beb2e3-b291-400b-bdff-e9da973ec206]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260]
Nov 06 05:59:12 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260] successful.
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b83a196-3b9f-4d7c-8993-2e8da814ab89]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c84e4-8ffa-4c99-86db-647703d31a30]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[447e124e-84c6-4d19-aa89-3a024a31303d]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26634623436653066', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634623436653066', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622863304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622863304',id=13,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-rrug10ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:09Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=42720fc5-a750-4108-bd41-f8834bc4edee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:59:13 user nova-compute[74903]:   <uuid>42720fc5-a750-4108-bd41-f8834bc4edee</uuid>
Nov 06 05:59:13 user nova-compute[74903]:   <name>instance-0000000d</name>
Nov 06 05:59:13 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:59:13 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:59:13 user nova-compute[74903]:   <metadata>
Nov 06 05:59:13 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:59:13 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1622863304</nova:name>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:59:12</nova:creationTime>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:59:13 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:59:13 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:owner>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 05:59:13 user nova-compute[74903]:       </nova:owner>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:59:13 user nova-compute[74903]:       <nova:ports>
Nov 06 05:59:13 user nova-compute[74903]:         <nova:port uuid="ad661255-20e8-4a90-a42f-3a7d37b4c04d">
Nov 06 05:59:13 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 05:59:13 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:13 user nova-compute[74903]:       </nova:ports>
Nov 06 05:59:13 user nova-compute[74903]:     </nova:instance>
Nov 06 05:59:13 user nova-compute[74903]:   </metadata>
Nov 06 05:59:13 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:59:13 user nova-compute[74903]:     <system>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="serial">42720fc5-a750-4108-bd41-f8834bc4edee</entry>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="uuid">42720fc5-a750-4108-bd41-f8834bc4edee</entry>
Nov 06 05:59:13 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:59:13 user nova-compute[74903]:     </system>
Nov 06 05:59:13 user nova-compute[74903]:   </sysinfo>
Nov 06 05:59:13 user nova-compute[74903]:   <os>
Nov 06 05:59:13 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:59:13 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:59:13 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:59:13 user nova-compute[74903]:   </os>
Nov 06 05:59:13 user nova-compute[74903]:   <features>
Nov 06 05:59:13 user nova-compute[74903]:     <acpi/>
Nov 06 05:59:13 user nova-compute[74903]:     <apic/>
Nov 06 05:59:13 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:59:13 user nova-compute[74903]:   </features>
Nov 06 05:59:13 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:59:13 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:59:13 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:59:13 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:59:13 user nova-compute[74903]:   </clock>
Nov 06 05:59:13 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:59:13 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:59:13 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:59:13 user nova-compute[74903]:   </cpu>
Nov 06 05:59:13 user nova-compute[74903]:   <devices>
Nov 06 05:59:13 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:59:13 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:59:13 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 05:59:13 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:59:13 user nova-compute[74903]:       <serial>5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a</serial>
Nov 06 05:59:13 user nova-compute[74903]:     </disk>
Nov 06 05:59:13 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:13 user nova-compute[74903]:       <mac address="fa:16:3e:6e:f6:48"/>
Nov 06 05:59:13 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:13 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:13 user nova-compute[74903]:       <target dev="tapad661255-20"/>
Nov 06 05:59:13 user nova-compute[74903]:     </interface>
Nov 06 05:59:13 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:59:13 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/console.log" append="off"/>
Nov 06 05:59:13 user nova-compute[74903]:     </serial>
Nov 06 05:59:13 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:59:13 user nova-compute[74903]:     <video>
Nov 06 05:59:13 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:13 user nova-compute[74903]:     </video>
Nov 06 05:59:13 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:59:13 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:59:13 user nova-compute[74903]:     </rng>
Nov 06 05:59:13 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:59:13 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:59:13 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:59:13 user nova-compute[74903]:     </memballoon>
Nov 06 05:59:13 user nova-compute[74903]:   </devices>
Nov 06 05:59:13 user nova-compute[74903]: </domain>
Nov 06 05:59:13 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622863304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622863304',id=13,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-rrug10ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:09Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=42720fc5-a750-4108-bd41-f8834bc4edee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG os_vif [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77257fe2-2f10-5d27-bd0d-789d7ddf2b42', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad661255-20, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad661255-20, col_values=(('qos', UUID('4bacbfac-91bb-461e-9080-28c50523f71f')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad661255-20, col_values=(('external_ids', {'iface-id': 'ad661255-20e8-4a90-a42f-3a7d37b4c04d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:f6:48', 'vm-uuid': '42720fc5-a750-4108-bd41-f8834bc4edee'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:13 user nova-compute[74903]: INFO os_vif [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20')
Nov 06 05:59:13 user nova-compute[74903]: INFO nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Booting with volume 8387f9d7-9d83-4bed-8aca-e8f701d03151 at /dev/vdc
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:6e:f6:48, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:59:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=25.562957763671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb315e3-9c61-4d86-86b9-ac05374aee0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf14294e-355d-441e-93ef-09e5689fd2f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a7e66-b1a1-4dfb-9d0e-ae618066ed60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5886fb5-b455-4db2-a8db-192f44c30abe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:59:14 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cffe632-53e3-4950-bf43-a84344ec7097]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating existing volume attachment record: 678c502f-29ad-4c9f-8fa3-3cf693ae9369 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c6a9cf35-00cf-45b9-8727-267f150024a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance ce617b70-08a4-492d-a9ec-138cc4990e20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 05:59:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:15 user nova-compute[74903]: WARNING nova.compute.manager [req-f28165b7-1186-423f-8d8f-ab676f20acce req-ea27be29-da47-4737-bd37-bd249babd8c6 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state building and task_state spawning.
Nov 06 05:59:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:17 user nova-compute[74903]: WARNING nova.compute.manager [req-22965853-4d59-4800-8e77-3743fc33077e req-9faca335-98e6-4ad7-8128-fa1babfe77f4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state building and task_state spawning.
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:59:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance spawned successfully.
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:18 user nova-compute[74903]: INFO nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 06 05:59:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:59:18 user nova-compute[74903]: INFO nova.compute.manager [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Took 70.37 seconds to build instance.
Nov 06 05:59:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fded8e76-de37-423e-8178-29bdb228cac5 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 70.538s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-changed-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Refreshing instance network info cache due to event network-changed-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] Acquiring lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] Acquired lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Refreshing network info cache for port d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.objects.instance [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:35 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Ignoring supplied device name: /dev/vdb
Nov 06 05:59:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updated VIF entry in instance network info cache for port d69689dd-cfb2-40c5-b1fa-c3ef299f41bf. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 05:59:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updating instance_info_cache with network_info: [{"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bbda15b5-acda-4992-ae95-bfe8f17c8cec req-79988c49-8ea9-4f31-9b24-c253a80e6bcb service nova] Releasing lock "refresh_cache-9bbe873d-de34-4367-8ff5-d2e1b98b23a3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:36 user nova-compute[74903]: INFO nova.compute.manager [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Attaching volume 96a676a5-a1bd-43f0-b76a-848f316c3262 to /dev/vdb
Nov 06 05:59:36 user nova-compute[74903]: DEBUG os_brick.utils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93d5c9e-56ac-4a9d-a927-08b6fe148f4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60688d63-1270-4ca5-b85f-8de4f30c5560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b311764-0d03-44ec-8d5d-1c464e7a4dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffdb5b-1433-417c-bf23-5cd3c3f17d17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 05:59:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 05:59:37 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 05:59:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[93edaf26-1a0c-47f8-b6f0-e00023fd3d33]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG os_brick.utils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:37 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updating existing volume attachment record: 477f9349-cceb-4849-9032-0f61dd2cf92a {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 05:59:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 05:59:39 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Creating image(s)
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Ensure instance console log exists: /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Start _get_guest_xml network_info=[{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbkIVWuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a', 'attached_at': '', 'detached_at': '', 'volume_id': '36ab9587-36a8-43b3-8a92-a64dce74eeb8', 'serial': '36ab9587-36a8-43b3-8a92-a64dce74eeb8'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'e2af4098-2788-4b51-b65e-33a79330b7e3', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkLbNZTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a', 'attached_at': '', 'detached_at': '', 'volume_id': 'be243b7c-c47d-448f-bf28-3732328c00c6', 'serial': 'be243b7c-c47d-448f-bf28-3732328c00c6'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'attachment_id': '72b7feab-ae37-43ec-ab0e-31ba7d4ee011', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwCJKlSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a', 'attached_at': '', 'detached_at': '', 'volume_id': '8387f9d7-9d83-4bed-8aca-e8f701d03151', 'serial': '8387f9d7-9d83-4bed-8aca-e8f701d03151'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'attachment_id': '678c502f-29ad-4c9f-8fa3-3cf693ae9369', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 05:59:39 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:39 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbkIVWuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:39 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:39 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:39 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfb398f-29c6-46cc-9de2-7723273fc445]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:59:39 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef6beb7-c827-46bf-831e-fbbe1d512ec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8] added
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5052b0cd-da6c-4ff7-9f96-9440c3f49087]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b1277-fd6e-4aec-b829-3efddca15408]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbkIVWuJ {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbkIVWuJ" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462f9d7-6c51-47a3-9037-d97b22c4175d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbkIVWuJ'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ee4db-96de-404e-8751-fbac873286e8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea399eed-9b53-4df0-adb4-80fc910a899c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[de878120-d50c-4b94-a60e-c1cf312d903c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260]
Nov 06 05:59:39 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260] successful.
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fd2e79-fe80-49e7-9622-3eeaaa7b5998]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a987fb9f-efa6-495d-82af-31748fed4d9c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:39 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1eeb94-4bdb-42d8-bf45-f0c6c08a2efe]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:59:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbkIVWuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23739393839633965', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739393839633965', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkLbNZTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:40 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fdf53e-00d4-401d-9952-024ce7c11238]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:59:40 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a9a918-8aae-4c83-bd0e-bc5153570310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6] added
Nov 06 05:59:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b01346-b759-4cd5-82c1-b6380e38231f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc0f27a-52b0-4943-be2d-7ed4557c1977]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkLbNZTP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkLbNZTP" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44aa81-34d1-4247-99c9-d7ebf3364fea]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkLbNZTP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6799b1-97f5-4f0e-90a1-4fb98cbb9925]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a74484-0256-4de6-9dce-b13c236bc7dc]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c16e45-220a-4f70-beee-5729fca0c16c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260]
Nov 06 05:59:41 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260] successful.
Nov 06 05:59:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eccb209-b7d5-4607-a81c-6899d9005438]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd93603-7ec0-4749-90ac-b2dce3a00c86]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:41 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a054ea-79af-45f4-96d7-9f2d81928145]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:59:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkLbNZTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23132643230393231', 'path': '/dev/sdg'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132643230393231', 'path': '/dev/sdg'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwCJKlSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 05:59:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 05:59:42 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee38133-4644-41dd-b9bb-e0100bb3030f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 05:59:42 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfcacea-6429-40ce-9df6-5f2e74c10167]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151] added
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c2eaf5-0563-40f3-a7a4-6d15130e189d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd97078-97f1-4d4f-a5b7-fcee1f18fed4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DwCJKlSp {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DwCJKlSp" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c555001-9eb0-4932-838a-90a9996870a5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DwCJKlSp'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e6ca1-a65d-478b-b467-b3df63154e70]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a546c-a65e-48cc-820c-e2c9b7cddd5e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f027cc11-72e7-40b2-8738-df0f0411d095]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260]
Nov 06 05:59:42 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260] successful.
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[14835975-fd89-49b6-abf7-9634e3b1da1e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e6e75-6d54-4468-a120-221b7a18f744]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 05:59:42 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 05:59:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbf475-4b1f-4fae-9079-d99eb34c9c72]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 05:59:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwCJKlSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23561613961643862', 'path': '/dev/sdh'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561613961643862', 'path': '/dev/sdh'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lazy-loading 'pci_devices' on Instance uuid f7993894-5fb4-4f9f-ac9f-85afdf95993a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 05:59:43 user nova-compute[74903]:   <uuid>f7993894-5fb4-4f9f-ac9f-85afdf95993a</uuid>
Nov 06 05:59:43 user nova-compute[74903]:   <name>instance-0000000e</name>
Nov 06 05:59:43 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 05:59:43 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 05:59:43 user nova-compute[74903]:   <metadata>
Nov 06 05:59:43 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 05:59:43 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:name>tempest-device-tagging-server-529108490</nova:name>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:creationTime>2023-11-06 05:59:39</nova:creationTime>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 05:59:43 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 05:59:43 user nova-compute[74903]:       </nova:flavor>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:owner>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:user uuid="35c7b2dde4a64ce3a23a67df5423a16e">tempest-TaggedBootDevicesTest_v242-162766746-project-member</nova:user>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:project uuid="b1cb0f6959fa4b9e869f688933b80d82">tempest-TaggedBootDevicesTest_v242-162766746</nova:project>
Nov 06 05:59:43 user nova-compute[74903]:       </nova:owner>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 05:59:43 user nova-compute[74903]:       <nova:ports>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="41646a38-a4db-4ca6-bf7e-1dc23226895f">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="bf7ef72e-bf3a-47df-894a-2fcab391d313">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="0c3693dc-a0af-46af-9b72-68ecc6d5254d">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.116" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="734d3dde-050e-4cb9-85f2-c01641898cdb">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="b750304d-4335-4a4d-b9d6-1ac5c20e0fe6">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="d6e82787-dae3-4353-8541-ce24b080e154">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:         <nova:port uuid="f882adc1-0815-4977-9b82-bcfbb03ce30b">
Nov 06 05:59:43 user nova-compute[74903]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 05:59:43 user nova-compute[74903]:         </nova:port>
Nov 06 05:59:43 user nova-compute[74903]:       </nova:ports>
Nov 06 05:59:43 user nova-compute[74903]:     </nova:instance>
Nov 06 05:59:43 user nova-compute[74903]:   </metadata>
Nov 06 05:59:43 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 05:59:43 user nova-compute[74903]:     <system>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="serial">f7993894-5fb4-4f9f-ac9f-85afdf95993a</entry>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="uuid">f7993894-5fb4-4f9f-ac9f-85afdf95993a</entry>
Nov 06 05:59:43 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 05:59:43 user nova-compute[74903]:     </system>
Nov 06 05:59:43 user nova-compute[74903]:   </sysinfo>
Nov 06 05:59:43 user nova-compute[74903]:   <os>
Nov 06 05:59:43 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 05:59:43 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 05:59:43 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 05:59:43 user nova-compute[74903]:   </os>
Nov 06 05:59:43 user nova-compute[74903]:   <features>
Nov 06 05:59:43 user nova-compute[74903]:     <acpi/>
Nov 06 05:59:43 user nova-compute[74903]:     <apic/>
Nov 06 05:59:43 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 05:59:43 user nova-compute[74903]:   </features>
Nov 06 05:59:43 user nova-compute[74903]:   <clock offset="utc">
Nov 06 05:59:43 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 05:59:43 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 05:59:43 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 05:59:43 user nova-compute[74903]:   </clock>
Nov 06 05:59:43 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 05:59:43 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 05:59:43 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 05:59:43 user nova-compute[74903]:   </cpu>
Nov 06 05:59:43 user nova-compute[74903]:   <devices>
Nov 06 05:59:43 user nova-compute[74903]:     <disk type="file" device="cdrom">
Nov 06 05:59:43 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 05:59:43 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/disk.config"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="hda" bus="ide"/>
Nov 06 05:59:43 user nova-compute[74903]:     </disk>
Nov 06 05:59:43 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:59:43 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:59:43 user nova-compute[74903]:       <source dev="/dev/sdf"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <serial>36ab9587-36a8-43b3-8a92-a64dce74eeb8</serial>
Nov 06 05:59:43 user nova-compute[74903]:     </disk>
Nov 06 05:59:43 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:59:43 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:59:43 user nova-compute[74903]:       <source dev="/dev/sdg"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <serial>be243b7c-c47d-448f-bf28-3732328c00c6</serial>
Nov 06 05:59:43 user nova-compute[74903]:     </disk>
Nov 06 05:59:43 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 05:59:43 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 05:59:43 user nova-compute[74903]:       <source dev="/dev/sdh"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="vdc" bus="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <serial>8387f9d7-9d83-4bed-8aca-e8f701d03151</serial>
Nov 06 05:59:43 user nova-compute[74903]:     </disk>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:d8:a6:88"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tap41646a38-a4"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:66:16:b4"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tapbf7ef72e-bf"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:ed:82:65"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tap0c3693dc-a0"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:1f:71:7b"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tap734d3dde-05"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:3a:fb:63"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tapb750304d-43"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:ff:4a:cb"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tapd6e82787-da"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 05:59:43 user nova-compute[74903]:       <mac address="fa:16:3e:6c:1c:bb"/>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 05:59:43 user nova-compute[74903]:       <target dev="tapf882adc1-08"/>
Nov 06 05:59:43 user nova-compute[74903]:     </interface>
Nov 06 05:59:43 user nova-compute[74903]:     <serial type="pty">
Nov 06 05:59:43 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/console.log" append="off"/>
Nov 06 05:59:43 user nova-compute[74903]:     </serial>
Nov 06 05:59:43 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 05:59:43 user nova-compute[74903]:     <video>
Nov 06 05:59:43 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 05:59:43 user nova-compute[74903]:     </video>
Nov 06 05:59:43 user nova-compute[74903]:     <rng model="virtio">
Nov 06 05:59:43 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 05:59:43 user nova-compute[74903]:     </rng>
Nov 06 05:59:43 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 05:59:43 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 05:59:43 user nova-compute[74903]:       <stats period="10"/>
Nov 06 05:59:43 user nova-compute[74903]:     </memballoon>
Nov 06 05:59:43 user nova-compute[74903]:   </devices>
Nov 06 05:59:43 user nova-compute[74903]: </domain>
Nov 06 05:59:43 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85081116-2c16-5eff-978a-fb24ccd7c721', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41646a38-a4, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41646a38-a4, col_values=(('qos', UUID('317f3922-7824-4929-abd0-2707a74f94cb')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41646a38-a4, col_values=(('external_ids', {'iface-id': '41646a38-a4db-4ca6-bf7e-1dc23226895f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:a6:88', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4')
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7b00dd8-e578-54b4-beb5-9002d4f499f2', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf7ef72e-bf, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf7ef72e-bf, col_values=(('qos', UUID('d38df371-167c-4541-92eb-35a5d813f2ec')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf7ef72e-bf, col_values=(('external_ids', {'iface-id': 'bf7ef72e-bf3a-47df-894a-2fcab391d313', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:16:b4', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:43 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf')
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '495abcd1-38cf-5e76-9eb2-d1f2b982977f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c3693dc-a0, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c3693dc-a0, col_values=(('qos', UUID('c6681bbb-ef8d-436d-a4d4-7adfc6e09ebc')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c3693dc-a0, col_values=(('external_ids', {'iface-id': '0c3693dc-a0af-46af-9b72-68ecc6d5254d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:82:65', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0')
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc930fe4-b5b1-5db3-bd76-0df853248916', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap734d3dde-05, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap734d3dde-05, col_values=(('qos', UUID('38d181ff-d088-4415-ace7-92f92041ed4a')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap734d3dde-05, col_values=(('external_ids', {'iface-id': '734d3dde-050e-4cb9-85f2-c01641898cdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:71:7b', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05')
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b211c00f-6327-5ffe-ba70-436d34eb37e8', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb750304d-43, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb750304d-43, col_values=(('qos', UUID('9c197cac-3860-44b4-9d9f-960191c50da7')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb750304d-43, col_values=(('external_ids', {'iface-id': 'b750304d-4335-4a4d-b9d6-1ac5c20e0fe6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:fb:63', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43')
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fbf5bf9-208b-5619-be02-e1b2fa8c10df', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6e82787-da, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6e82787-da, col_values=(('qos', UUID('82a77af3-1cd5-4b3c-86f4-5ae1b3521de3')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6e82787-da, col_values=(('external_ids', {'iface-id': 'd6e82787-dae3-4353-8541-ce24b080e154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:4a:cb', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da')
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9628348-06e7-5dbc-8e2f-9124dd212574', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf882adc1-08, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf882adc1-08, col_values=(('qos', UUID('2c361496-d622-4d6d-bc8e-67184b8a9378')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf882adc1-08, col_values=(('external_ids', {'iface-id': 'f882adc1-0815-4977-9b82-bcfbb03ce30b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:1c:bb', 'vm-uuid': 'f7993894-5fb4-4f9f-ac9f-85afdf95993a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:44 user nova-compute[74903]: INFO os_vif [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08')
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] No BDM found with device name hda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] No VIF found with MAC fa:16:3e:d8:a6:88, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:59:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] No VIF found with MAC fa:16:3e:3a:fb:63, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 05:59:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Using config drive
Nov 06 05:59:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Creating config drive at /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/disk.config
Nov 06 05:59:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxzwol276 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 05:59:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxzwol276" returned: 0 in 0.074s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 05:59:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:47 user nova-compute[74903]: WARNING nova.compute.manager [req-2144b602-cdc6-4428-80ce-e6036e990300 req-ff741937-322e-4424-8efa-7d769907afea service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f for instance with vm_state building and task_state spawning.
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:47 user nova-compute[74903]: INFO nova.compute.manager [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Terminating instance
Nov 06 05:59:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-unplugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] No waiting events found dispatching network-vif-unplugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-bb8ffe43-e518-44c8-8e56-6071c9c20af8 req-f24fc5f6-0d56-499b-a6fb-5abb5d0ba82e service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-unplugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:48 user nova-compute[74903]: WARNING nova.compute.manager [req-47c4026b-4e2a-4863-80c3-fe00f2d844c8 req-229e3bd5-7f3f-496f-990a-04043c4ed143 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 for instance with vm_state building and task_state spawning.
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Instance destroyed successfully.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lazy-loading 'resources' on Instance uuid c6a9cf35-00cf-45b9-8727-267f150024a9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2049275497',display_name='tempest-VolumesAssistedSnapshotsTest-server-2049275497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2049275497',id=8,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlonfE76DqAW8aan8soNKSpWdvjiCcCJ+99uiEaJdFg7uO8jmwA0wgfElFsRzLg2wWi1sSGfD57sBdzjXqjrZk5irY4GISqa/BtmveuBVRWSmJF/am/xzZTBu5YpfF9eA==',key_name='tempest-keypair-625809800',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8118c385b9a4fb18fc87412ae6d7673',ramdisk_id='',reservation_id='r-ey9dfq5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1048584358',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1048584358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:55:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11a56f4a67554df7b957d26655ca86af',uuid=c6a9cf35-00cf-45b9-8727-267f150024a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converting VIF {"id": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "address": "fa:16:3e:da:cc:f5", "network": {"id": "945625e8-fcfc-4d18-874b-8b733f95f380", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1533735377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8118c385b9a4fb18fc87412ae6d7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8973d6-66", "ovs_interfaceid": "9c8973d6-665a-4a19-b06a-0c18069bbf07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG os_vif [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8973d6-66, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:49 user nova-compute[74903]: WARNING nova.compute.manager [req-deb85512-2f19-4e2d-8233-587e76db4b0a req-f9f849c3-098a-42db-b6be-fc0429b05e16 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb for instance with vm_state building and task_state spawning.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebcf715b-8224-489b-bfd2-a1dd04c9978c) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: INFO os_vif [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:cc:f5,bridge_name='br-int',has_traffic_filtering=True,id=9c8973d6-665a-4a19-b06a-0c18069bbf07,network=Network(945625e8-fcfc-4d18-874b-8b733f95f380),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8973d6-66')
Nov 06 05:59:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Deleting instance files /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9_del
Nov 06 05:59:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Deletion of /opt/stack/data/nova/instances/c6a9cf35-00cf-45b9-8727-267f150024a9_del complete
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: INFO nova.compute.manager [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Took 1.76 seconds to destroy the instance on the hypervisor.
Nov 06 05:59:49 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Acquiring lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] No waiting events found dispatching network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:50 user nova-compute[74903]: WARNING nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received unexpected event network-vif-plugged-9c8973d6-665a-4a19-b06a-0c18069bbf07 for instance with vm_state active and task_state deleting.
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:50 user nova-compute[74903]: WARNING nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b for instance with vm_state building and task_state spawning.
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:50 user nova-compute[74903]: WARNING nova.compute.manager [req-20aad71a-5e5d-4a14-96ed-14d2646108da req-5d6baf9e-7232-46ab-b901-a836efc81e68 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b for instance with vm_state building and task_state spawning.
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 05:59:50 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Took 0.91 seconds to deallocate network for instance.
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:50 user nova-compute[74903]: WARNING nova.compute.manager [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 for instance with vm_state building and task_state spawning.
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-36f63ae2-a183-4470-8cb4-e9f755b0c313 req-72c089e8-9e09-4b42-874e-2b261dc1d44b service nova] [instance: c6a9cf35-00cf-45b9-8727-267f150024a9] Received event network-vif-deleted-9c8973d6-665a-4a19-b06a-0c18069bbf07 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 05:59:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:51 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Deleted allocations for instance c6a9cf35-00cf-45b9-8727-267f150024a9
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-66f4c12f-40f8-4620-a4f2-9f1651cc06af tempest-VolumesAssistedSnapshotsTest-1048584358 tempest-VolumesAssistedSnapshotsTest-1048584358-project-member] Lock "c6a9cf35-00cf-45b9-8727-267f150024a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.402s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:51 user nova-compute[74903]: WARNING nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 for instance with vm_state building and task_state spawning.
Nov 06 05:59:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 05:59:51 user nova-compute[74903]: WARNING nova.compute.manager [req-f6fd3f20-e5e2-4639-a001-7f448a62d078 req-1f7315e0-61ba-4948-8877-d9c73f2ca8b0 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 for instance with vm_state building and task_state spawning.
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 05:59:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance spawned successfully.
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 05:59:52 user nova-compute[74903]: INFO nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Took 12.70 seconds to spawn the instance on the hypervisor.
Nov 06 05:59:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 05:59:52 user nova-compute[74903]: INFO nova.compute.manager [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Took 92.56 seconds to build instance.
Nov 06 05:59:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0646834-3097-47b5-ae59-c56328284e48 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 92.665s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 05:59:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 05:59:59 user nova-compute[74903]: INFO nova.compute.manager [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Rescuing
Nov 06 05:59:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-changed-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing instance network info cache due to event network-changed-1843bb97-2178-4df3-aa6a-d6472964d761. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] Acquiring lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] Acquired lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 05:59:59 user nova-compute[74903]: DEBUG nova.network.neutron [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Refreshing network info cache for port 1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updated VIF entry in instance network info cache for port 1843bb97-2178-4df3-aa6a-d6472964d761. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dfcece6-54b3-4ffe-877b-f929492954c9 req-74d1c56c-a945-475c-8c9a-c8d2abab7ad4 service nova] Releasing lock "refresh_cache-ce617b70-08a4-492d-a9ec-138cc4990e20" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:01 user nova-compute[74903]: WARNING nova.compute.manager [req-bf539790-5cd0-402a-b364-d89db01af8d3 req-1ce2daa4-f979-40fb-a83e-502535e841c7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state rescuing.
Nov 06 06:00:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance destroyed successfully.
Nov 06 06:00:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Attempting rescue
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:00:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Creating image(s)
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'trusted_certs' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.249s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue" returned: 0 in 0.063s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'migration_context' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.base [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<62b95f70-d2ef-4b37-9e0f-2fa8477642de> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start _get_guest_xml network_info=[{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:6c:4c:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.base [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<62b95f70-d2ef-4b37-9e0f-2fa8477642de> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'numa_topology' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.base [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<62b95f70-d2ef-4b37-9e0f-2fa8477642de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.base [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<62b95f70-d2ef-4b37-9e0f-2fa8477642de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1277920532',display_name='tempest-ServerRescueNegativeTestJSON-server-1277920532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1277920532',id=3,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-5ylx3b5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:55:29Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=62b95f70-d2ef-4b37-9e0f-2fa8477642de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:6c:4c:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:6c:4c:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.objects.base [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<62b95f70-d2ef-4b37-9e0f-2fa8477642de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:00:02 user nova-compute[74903]:   <uuid>62b95f70-d2ef-4b37-9e0f-2fa8477642de</uuid>
Nov 06 06:00:02 user nova-compute[74903]:   <name>instance-00000003</name>
Nov 06 06:00:02 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:00:02 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:00:02 user nova-compute[74903]:   <metadata>
Nov 06 06:00:02 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:00:02 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1277920532</nova:name>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:00:02</nova:creationTime>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:00:02 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:00:02 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:owner>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 06:00:02 user nova-compute[74903]:       </nova:owner>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:00:02 user nova-compute[74903]:       <nova:ports>
Nov 06 06:00:02 user nova-compute[74903]:         <nova:port uuid="82f5f3d5-a09c-4e30-a784-c9bab97400ab">
Nov 06 06:00:02 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:00:02 user nova-compute[74903]:         </nova:port>
Nov 06 06:00:02 user nova-compute[74903]:       </nova:ports>
Nov 06 06:00:02 user nova-compute[74903]:     </nova:instance>
Nov 06 06:00:02 user nova-compute[74903]:   </metadata>
Nov 06 06:00:02 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:00:02 user nova-compute[74903]:     <system>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="serial">62b95f70-d2ef-4b37-9e0f-2fa8477642de</entry>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="uuid">62b95f70-d2ef-4b37-9e0f-2fa8477642de</entry>
Nov 06 06:00:02 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:00:02 user nova-compute[74903]:     </system>
Nov 06 06:00:02 user nova-compute[74903]:   </sysinfo>
Nov 06 06:00:02 user nova-compute[74903]:   <os>
Nov 06 06:00:02 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:00:02 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:00:02 user nova-compute[74903]:   </os>
Nov 06 06:00:02 user nova-compute[74903]:   <features>
Nov 06 06:00:02 user nova-compute[74903]:     <acpi/>
Nov 06 06:00:02 user nova-compute[74903]:     <apic/>
Nov 06 06:00:02 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:00:02 user nova-compute[74903]:   </features>
Nov 06 06:00:02 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:00:02 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:00:02 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:00:02 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:00:02 user nova-compute[74903]:   </clock>
Nov 06 06:00:02 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:00:02 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:00:02 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:00:02 user nova-compute[74903]:   </cpu>
Nov 06 06:00:02 user nova-compute[74903]:   <devices>
Nov 06 06:00:02 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:00:02 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:00:02 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue"/>
Nov 06 06:00:02 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:00:02 user nova-compute[74903]:     </disk>
Nov 06 06:00:02 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:00:02 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:00:02 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk"/>
Nov 06 06:00:02 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:00:02 user nova-compute[74903]:     </disk>
Nov 06 06:00:02 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:00:02 user nova-compute[74903]:       <mac address="fa:16:3e:6c:4c:c1"/>
Nov 06 06:00:02 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:02 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:00:02 user nova-compute[74903]:       <target dev="tap82f5f3d5-a0"/>
Nov 06 06:00:02 user nova-compute[74903]:     </interface>
Nov 06 06:00:02 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:00:02 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/console.log" append="off"/>
Nov 06 06:00:02 user nova-compute[74903]:     </serial>
Nov 06 06:00:02 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:00:02 user nova-compute[74903]:     <video>
Nov 06 06:00:02 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:02 user nova-compute[74903]:     </video>
Nov 06 06:00:02 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:00:02 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:00:02 user nova-compute[74903]:     </rng>
Nov 06 06:00:02 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:00:02 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:00:02 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:00:02 user nova-compute[74903]:     </memballoon>
Nov 06 06:00:02 user nova-compute[74903]:   </devices>
Nov 06 06:00:02 user nova-compute[74903]: </domain>
Nov 06 06:00:02 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:00:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance destroyed successfully.
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:6c:4c:c1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:03 user nova-compute[74903]: INFO nova.compute.manager [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Terminating instance
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:03 user nova-compute[74903]: WARNING nova.compute.manager [req-8dc19571-94df-4c67-92ba-26347ca85502 req-5dd28219-7241-46c6-b87b-cde1cd463b48 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state rescuing.
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-046d203d-762f-4847-9e4e-d46c1b9e90bc req-286cc18f-3362-41fc-ab12-05dfdb17a3bf service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-d0742d33-c506-49a8-8629-5d4ca630014e for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-452f419c-2daf-400c-b396-482b0aebd45c req-e9b49686-5e72-4688-830d-d129609c2c69 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-1843bb97-2178-4df3-aa6a-d6472964d761 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Instance destroyed successfully.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lazy-loading 'resources' on Instance uuid ce617b70-08a4-492d-a9ec-138cc4990e20 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1843bb97-21, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e8b588e-77b6-49b2-b9ce-c03b3fbb2b5e) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state rescuing.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING nova.compute.manager [req-cb8f7248-c32b-4db6-9b80-c6e1b4325eb8 req-45363853-90d0-469f-b3c9-24568f987782 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state active and task_state rescuing.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:63:ed,bridge_name='br-int',has_traffic_filtering=True,id=1843bb97-2178-4df3-aa6a-d6472964d761,network=Network(915c23a2-bf62-4d46-8bdd-badc3b544ce6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1843bb97-21')
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0742d33-c5, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62abcee5-05f4-4f9b-bcfd-725b59bb709b) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:17:43,bridge_name='br-int',has_traffic_filtering=True,id=d0742d33-c506-49a8-8629-5d4ca630014e,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd0742d33-c5')
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0024f2e-1d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-d0742d33-c506-49a8-8629-5d4ca630014e for instance with vm_state active and task_state deleting.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-073f527c-ea48-488a-bc51-56124b43fa5d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-073f527c-ea48-488a-bc51-56124b43fa5d for instance with vm_state active and task_state deleting.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 for instance with vm_state active and task_state deleting.
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-415a04b6-d7a0-4f09-a364-159f64a3fa86 req-df14283a-835c-46c0-9607-6af6e0e658be service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-20a57265-77dc-4c93-8c3a-b1055941b513 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bb30efc-ed2f-41ee-bcd8-8be2ad3332a8) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMcqfxbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:05 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:05 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:05 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:dc:f5,bridge_name='br-int',has_traffic_filtering=True,id=e0024f2e-1da9-4744-a3f9-d6805bbe8657,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape0024f2e-1d')
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073f527c-ea, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ea6aa-d119-444e-a733-cfcf42e4af85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:00:05 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea7afd-5967-42f5-a323-8e136e7a574d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262] added
Nov 06 06:00:05 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5935a5b3-5958-4065-98a0-e48b42120283) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e429946-4d05-408f-89b0-dd31825ea61f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:18:aa,bridge_name='br-int',has_traffic_filtering=True,id=073f527c-ea48-488a-bc51-56124b43fa5d,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073f527c-ea')
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "address": "fa:16:3e:09:b7:25", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a5dea2-48", "ovs_interfaceid": "65a5dea2-48f7-455b-9cd8-9f08ca8244a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da57bab-4217-40a5-9a75-7fadc1eff374]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65a5dea2-48, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMcqfxbS {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=721f6c9d-c24e-4830-8e74-043ca531c4de) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yMcqfxbS" returned: 0 in 0.040s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7368f0-2e18-4c25-a485-cffe0e303fea]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yMcqfxbS'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:06 user nova-compute[74903]: WARNING nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-1843bb97-2178-4df3-aa6a-d6472964d761 for instance with vm_state active and task_state deleting.
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:06 user nova-compute[74903]: WARNING nova.compute.manager [req-a1345f36-b1b3-4853-a826-e1340fb49a14 req-aaf071ec-d98b-4d90-9ca6-d33276a4e190 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-e0024f2e-1da9-4744-a3f9-d6805bbe8657 for instance with vm_state active and task_state deleting.
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139c728-1389-4495-85e1-fb420bb2b873]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b7:25,bridge_name='br-int',has_traffic_filtering=True,id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9,network=Network(452c8bcc-7223-4459-9fab-3ee8e57928c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a5dea2-48')
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20a57265-77, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=484ee5c6-ddaa-4645-bdf7-624977efa63a) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[077630aa-3d8b-4c49-8bb0-d143f5e6efd5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:26:1a,bridge_name='br-int',has_traffic_filtering=True,id=20a57265-77dc-4c93-8c3a-b1055941b513,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a57265-77')
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-152320898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-152320898',id=11,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pFaFd7wQJwYCwCvpLN5hamVerFPlvN2o5jdvuNEb/BYabNRCmppRuXsVha/5TnaiALAU+ovURYR6pLFbFOaUWcbRjQzXwbEMSRCxh+1B5gO+USR915oe/fmMTYd6Jyg==',key_name='tempest-keypair-272083250',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74bd8bf20dc14f17b2af834a5fa96602',ramdisk_id='',reservation_id='r-rah3cxr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1794490616',owner_user_name='tempest-TaggedBootDevicesTest-1794490616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:58:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b54e5d18967a4c71ad0a6d74a6d4fbcc',uuid=ce617b70-08a4-492d-a9ec-138cc4990e20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converting VIF {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfe77107-4f, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a5cfebb-411e-4b7d-9f01-6eb3781fe588) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:06 user nova-compute[74903]: INFO os_vif [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:38:ff,bridge_name='br-int',has_traffic_filtering=True,id=dfe77107-4f8c-445b-afd3-417b8de17897,network=Network(0ad871ad-9e73-4949-9eaf-4f7e117083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfe77107-4f')
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UgjXFnRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:06 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7de8f0-a93b-4919-8cb2-a4f171b1ba8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260]
Nov 06 06:00:06 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260] successful.
Nov 06 06:00:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0dc9fc-28f5-4544-8b16-af201c30fc5a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a887ec05-4678-4c8f-858b-3b7c9880215a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:06 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3210f2-15e1-4945-8e67-227bd1cb9ab6]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMcqfxbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:00:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bba26d-4067-4fda-be28-74caa87e7e13 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.535s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '23066646630366362', 'path': '/dev/sdi'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066646630366362', 'path': '/dev/sdi'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.204s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.objects.instance [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58f464-5872-4d94-b430-a33a60e510b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:00:07 user nova-compute[74903]: No targets found.
Nov 06 06:00:07 user nova-compute[74903]: iSNS:
Nov 06 06:00:07 user nova-compute[74903]: No targets found.
Nov 06 06:00:07 user nova-compute[74903]: STATIC:
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:00:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:07 user nova-compute[74903]: FIRMWARE:
Nov 06 06:00:07 user nova-compute[74903]: No targets found.
Nov 06 06:00:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:00:07 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:00:07 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:00:07 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:00:07 user nova-compute[74903]:   <source dev="/dev/sdi"/>
Nov 06 06:00:07 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:00:07 user nova-compute[74903]:   <serial>96a676a5-a1bd-43f0-b76a-848f316c3262</serial>
Nov 06 06:00:07 user nova-compute[74903]: </disk>
Nov 06 06:00:07 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02e507-8e3c-43fe-af53-81e4e7bb0459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d676b022-30a3-43d5-9220-48c9a43bc45d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:07 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087de9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e0f46-4554-463d-a999-7532ee58084a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea09a9-ffde-4d11-b28c-3fbe86e88f9b]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff279fc6-bcff-4255-842c-b517927beac1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705ec89-ff36-47cb-ae37-60cc83b9c627]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb73a67-9d65-42f0-89f4-ffa325bb855b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:07 user nova-compute[74903]: WARNING nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-20a57265-77dc-4c93-8c3a-b1055941b513 for instance with vm_state active and task_state deleting.
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-unplugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-unplugged-dfe77107-4f8c-445b-afd3-417b8de17897 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Acquiring lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] No waiting events found dispatching network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:07 user nova-compute[74903]: WARNING nova.compute.manager [req-964d9928-7f85-4a9b-8d2c-ad46af420897 req-6df9f691-c36d-479c-bc54-d8317a64aa28 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received unexpected event network-vif-plugged-dfe77107-4f8c-445b-afd3-417b8de17897 for instance with vm_state active and task_state deleting.
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.264s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95fb11b-7c9e-42bb-89f0-a945f5f62e63]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260]
Nov 06 06:00:08 user nova-compute[74903]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93, portal: 172.16.0.220,3260] successful.
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72628c58-0835-4652-a5c3-482eb93aab93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.066s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290f131-14b0-4c69-b401-b84bbf8318ed]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.677s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== disconnect_volume: return (1881ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MGEZBVmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:08 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ad76a-d4f4-4624-a108-f4ab67d15084]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]: iSNS:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]: STATIC:
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: FIRMWARE:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:00:08 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:00:08 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No VIF found with MAC fa:16:3e:51:8d:5d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5078e315-2730-4692-b402-65b14f1f5a18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1ab3b0-83ba-4ac8-a905-1a92fb04f54d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2843b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0336a10a-021d-4e10-99e2-37061e452ffb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[31623e3d-7478-43da-8a9d-3009c5174b67]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ad85b8-5c2f-431e-b6fb-5f939a3f3ff3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-90fd4bd8-f3b8-4752-9fc9-7378fe236752 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.670s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fabcbc8-42d2-4411-8c42-cf242587b32b]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69007b-d0ae-4109-8252-63fa27148bc5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d752ed4-34c2-420b-b6c9-0212439b6147]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260]
Nov 06 06:00:08 user nova-compute[74903]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46, portal: 172.16.0.220,3260] successful.
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:256c316a-b692-43fe-a01b-081cb29dbe46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73bb60-fd4e-4ee9-bf25-e349170be8dd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.501s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== disconnect_volume: return (503ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKIHPWpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:08 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[82945b50-c359-4ae8-8542-fcdd259a13cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]: iSNS:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]: STATIC:
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:00:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:00:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:00:08 user nova-compute[74903]: FIRMWARE:
Nov 06 06:00:08 user nova-compute[74903]: No targets found.
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:00:08 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:00:08 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7179097e-b012-4211-b062-daa6d8a658b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[74afb309-4afc-4b24-8a9e-621f7fe34e37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:08 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2843b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669'): ({'sde'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Removing single pathed devices sde {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56777d0d-f767-4227-ab55-f0e84a182896]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f100f21-0ea4-4ad7-9dd0-7ac8c7253594]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Flushing IO for device /dev/sde {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c312c3-a71f-47f7-9ec5-b72eeec9ea80]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5f3ad7-77e1-4896-855f-d0bd237481a7]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b3b751-83e6-4ea9-8192-01520afc4791]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f715381e-ae65-4e8a-9f21-1ecf001903e8]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260]
Nov 06 06:00:09 user nova-compute[74903]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669, portal: 172.16.0.220,3260] successful.
Nov 06 06:00:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8e855e8-844a-451b-ad93-d91d4e30a669 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e7ccc-e917-4578-8100-38be48a27d42]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] <== disconnect_volume: return (441ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:00:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Deleting instance files /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20_del
Nov 06 06:00:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Deletion of /opt/stack/data/nova/instances/ce617b70-08a4-492d-a9ec-138cc4990e20_del complete
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:00:09 user nova-compute[74903]: INFO nova.compute.manager [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Took 6.02 seconds to destroy the instance on the hypervisor.
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbcfda65-5ff5-452c-9108-98a12d8bc87d req-e8261ebf-c673-4fcf-a9c4-33a8a90c4fc6 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-deleted-65a5dea2-48f7-455b-9cd8-9f08ca8244a9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:12 user nova-compute[74903]: INFO nova.compute.manager [req-dbcfda65-5ff5-452c-9108-98a12d8bc87d req-e8261ebf-c673-4fcf-a9c4-33a8a90c4fc6 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Neutron deleted interface 65a5dea2-48f7-455b-9cd8-9f08ca8244a9; detaching it from the instance and deleting it from the info cache
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.network.neutron [req-dbcfda65-5ff5-452c-9108-98a12d8bc87d req-e8261ebf-c673-4fcf-a9c4-33a8a90c4fc6 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfe77107-4f8c-445b-afd3-417b8de17897", "address": "fa:16:3e:f6:38:ff", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfe77107-4f", "ovs_interfaceid": "dfe77107-4f8c-445b-afd3-417b8de17897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbcfda65-5ff5-452c-9108-98a12d8bc87d req-e8261ebf-c673-4fcf-a9c4-33a8a90c4fc6 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Detach interface failed, port_id=65a5dea2-48f7-455b-9cd8-9f08ca8244a9, reason: Instance ce617b70-08a4-492d-a9ec-138cc4990e20 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-deleted-dfe77107-4f8c-445b-afd3-417b8de17897 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:14 user nova-compute[74903]: INFO nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Neutron deleted interface dfe77107-4f8c-445b-afd3-417b8de17897; detaching it from the instance and deleting it from the info cache
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20a57265-77dc-4c93-8c3a-b1055941b513", "address": "fa:16:3e:c6:26:1a", "network": {"id": "0ad871ad-9e73-4949-9eaf-4f7e117083a4", "bridge": "br-int", "label": "tempest-device-tagging-net2-1648010885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a57265-77", "ovs_interfaceid": "20a57265-77dc-4c93-8c3a-b1055941b513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.58547592163086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Detach interface failed, port_id=dfe77107-4f8c-445b-afd3-417b8de17897, reason: Instance ce617b70-08a4-492d-a9ec-138cc4990e20 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-deleted-20a57265-77dc-4c93-8c3a-b1055941b513 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:14 user nova-compute[74903]: INFO nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Neutron deleted interface 20a57265-77dc-4c93-8c3a-b1055941b513; detaching it from the instance and deleting it from the info cache
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "1843bb97-2178-4df3-aa6a-d6472964d761", "address": "fa:16:3e:6b:63:ed", "network": {"id": "915c23a2-bf62-4d46-8bdd-badc3b544ce6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1183992707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1843bb97-21", "ovs_interfaceid": "1843bb97-2178-4df3-aa6a-d6472964d761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:14 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Took 5.32 seconds to deallocate network for instance.
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Detach interface failed, port_id=20a57265-77dc-4c93-8c3a-b1055941b513, reason: Instance ce617b70-08a4-492d-a9ec-138cc4990e20 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-deleted-1843bb97-2178-4df3-aa6a-d6472964d761 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:14 user nova-compute[74903]: INFO nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Neutron deleted interface 1843bb97-2178-4df3-aa6a-d6472964d761; detaching it from the instance and deleting it from the info cache
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "073f527c-ea48-488a-bc51-56124b43fa5d", "address": "fa:16:3e:1e:18:aa", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap073f527c-ea", "ovs_interfaceid": "073f527c-ea48-488a-bc51-56124b43fa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-a5ab3890-d461-4413-9965-880c03544c1d req-e3f00d8b-cda2-4413-bee2-79ca788e56f2 service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Detach interface failed, port_id=1843bb97-2178-4df3-aa6a-d6472964d761, reason: Instance ce617b70-08a4-492d-a9ec-138cc4990e20 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance ce617b70-08a4-492d-a9ec-138cc4990e20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:00:14 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:00:15 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:00:15 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:00:15 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:00:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-8879d710-ccaf-4105-89a4-a9c3fcf22f43 req-91d92705-af2f-4216-8a24-4ce1fc233d1e service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Received event network-vif-deleted-073f527c-ea48-488a-bc51-56124b43fa5d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:16 user nova-compute[74903]: INFO nova.compute.manager [req-8879d710-ccaf-4105-89a4-a9c3fcf22f43 req-91d92705-af2f-4216-8a24-4ce1fc233d1e service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Neutron deleted interface 073f527c-ea48-488a-bc51-56124b43fa5d; detaching it from the instance and deleting it from the info cache
Nov 06 06:00:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-8879d710-ccaf-4105-89a4-a9c3fcf22f43 req-91d92705-af2f-4216-8a24-4ce1fc233d1e service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Updating instance_info_cache with network_info: [{"id": "d0742d33-c506-49a8-8629-5d4ca630014e", "address": "fa:16:3e:68:17:43", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.121", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0742d33-c5", "ovs_interfaceid": "d0742d33-c506-49a8-8629-5d4ca630014e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "address": "fa:16:3e:07:dc:f5", "network": {"id": "452c8bcc-7223-4459-9fab-3ee8e57928c7", "bridge": "br-int", "label": "tempest-device-tagging-net1-882605014", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "74bd8bf20dc14f17b2af834a5fa96602", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0024f2e-1d", "ovs_interfaceid": "e0024f2e-1da9-4744-a3f9-d6805bbe8657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-8879d710-ccaf-4105-89a4-a9c3fcf22f43 req-91d92705-af2f-4216-8a24-4ce1fc233d1e service nova] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Detach interface failed, port_id=073f527c-ea48-488a-bc51-56124b43fa5d, reason: Instance ce617b70-08a4-492d-a9ec-138cc4990e20 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:00:17 user nova-compute[74903]: INFO nova.compute.manager [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] [instance: ce617b70-08a4-492d-a9ec-138cc4990e20] Took 3.11 seconds to detach 3 volumes for instance.
Nov 06 06:00:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:00:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:00:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:18 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Deleted allocations for instance ce617b70-08a4-492d-a9ec-138cc4990e20
Nov 06 06:00:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0d9dfa72-e57a-4e37-b2eb-b32ad5dbb70b tempest-TaggedBootDevicesTest-1794490616 tempest-TaggedBootDevicesTest-1794490616-project-member] Lock "ce617b70-08a4-492d-a9ec-138cc4990e20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.140s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:00:33 user nova-compute[74903]: INFO nova.compute.claims [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Claim successful on node user
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:00:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:00:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:00:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG nova.policy [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3960cc6199469581346258d3da93e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09e5d028d7f14e9898af48f92a1e3649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:00:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Creating image(s)
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "/opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "/opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "/opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.361s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk 1073741824" returned: 0 in 0.062s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:00:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Successfully created port: 624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Cannot resize image /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Ensure instance console log exists: /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Successfully updated port: 624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquired lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:00:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-changed-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Refreshing instance network info cache due to event network-changed-624be246-f0a3-4448-9c3b-8bfba73e4685. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] Acquiring lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating instance_info_cache with network_info: [{"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Releasing lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Instance network_info: |[{"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] Acquired lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Refreshing network info cache for port 624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Start _get_guest_xml network_info=[{"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:00:36 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:36 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1280916315',display_name='tempest-TestVolumeSwap-server-1280916315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1280916315',id=16,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxU3FOvhIUFxcuFF/GXGAAhqWLdDNEQbFPDoCM46c2SYRb25E/xpIBPIhSxgFzdS3tNsi7I+U2stPFZ1NfdjbvsMz8jOP822BYaS1BnbHFAsGTnH9sPY0pG9W1922e6gQ==',key_name='tempest-keypair-1457777091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e5d028d7f14e9898af48f92a1e3649',ramdisk_id='',reservation_id='r-gnksmr6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1869559139',owner_user_name='tempest-TestVolumeSwap-1869559139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3960cc6199469581346258d3da93e4',uuid=b781713b-1c98-4674-901c-a834bf648636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converting VIF {"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lazy-loading 'pci_devices' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:00:36 user nova-compute[74903]:   <uuid>b781713b-1c98-4674-901c-a834bf648636</uuid>
Nov 06 06:00:36 user nova-compute[74903]:   <name>instance-00000010</name>
Nov 06 06:00:36 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:00:36 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:00:36 user nova-compute[74903]:   <metadata>
Nov 06 06:00:36 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:00:36 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:name>tempest-TestVolumeSwap-server-1280916315</nova:name>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:00:36</nova:creationTime>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:00:36 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:00:36 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:owner>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:user uuid="1b3960cc6199469581346258d3da93e4">tempest-TestVolumeSwap-1869559139-project-member</nova:user>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:project uuid="09e5d028d7f14e9898af48f92a1e3649">tempest-TestVolumeSwap-1869559139</nova:project>
Nov 06 06:00:36 user nova-compute[74903]:       </nova:owner>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:00:36 user nova-compute[74903]:       <nova:ports>
Nov 06 06:00:36 user nova-compute[74903]:         <nova:port uuid="624be246-f0a3-4448-9c3b-8bfba73e4685">
Nov 06 06:00:36 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:00:36 user nova-compute[74903]:         </nova:port>
Nov 06 06:00:36 user nova-compute[74903]:       </nova:ports>
Nov 06 06:00:36 user nova-compute[74903]:     </nova:instance>
Nov 06 06:00:36 user nova-compute[74903]:   </metadata>
Nov 06 06:00:36 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:00:36 user nova-compute[74903]:     <system>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="serial">b781713b-1c98-4674-901c-a834bf648636</entry>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="uuid">b781713b-1c98-4674-901c-a834bf648636</entry>
Nov 06 06:00:36 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:00:36 user nova-compute[74903]:     </system>
Nov 06 06:00:36 user nova-compute[74903]:   </sysinfo>
Nov 06 06:00:36 user nova-compute[74903]:   <os>
Nov 06 06:00:36 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:00:36 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:00:36 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:00:36 user nova-compute[74903]:   </os>
Nov 06 06:00:36 user nova-compute[74903]:   <features>
Nov 06 06:00:36 user nova-compute[74903]:     <acpi/>
Nov 06 06:00:36 user nova-compute[74903]:     <apic/>
Nov 06 06:00:36 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:00:36 user nova-compute[74903]:   </features>
Nov 06 06:00:36 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:00:36 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:00:36 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:00:36 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:00:36 user nova-compute[74903]:   </clock>
Nov 06 06:00:36 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:00:36 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:00:36 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:00:36 user nova-compute[74903]:   </cpu>
Nov 06 06:00:36 user nova-compute[74903]:   <devices>
Nov 06 06:00:36 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:00:36 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:00:36 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk"/>
Nov 06 06:00:36 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:00:36 user nova-compute[74903]:     </disk>
Nov 06 06:00:36 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:00:36 user nova-compute[74903]:       <mac address="fa:16:3e:c6:ab:93"/>
Nov 06 06:00:36 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:36 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:00:36 user nova-compute[74903]:       <target dev="tap624be246-f0"/>
Nov 06 06:00:36 user nova-compute[74903]:     </interface>
Nov 06 06:00:36 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:00:36 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/console.log" append="off"/>
Nov 06 06:00:36 user nova-compute[74903]:     </serial>
Nov 06 06:00:36 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:00:36 user nova-compute[74903]:     <video>
Nov 06 06:00:36 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:36 user nova-compute[74903]:     </video>
Nov 06 06:00:36 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:00:36 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:00:36 user nova-compute[74903]:     </rng>
Nov 06 06:00:36 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:00:36 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:00:36 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:00:36 user nova-compute[74903]:     </memballoon>
Nov 06 06:00:36 user nova-compute[74903]:   </devices>
Nov 06 06:00:36 user nova-compute[74903]: </domain>
Nov 06 06:00:36 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1280916315',display_name='tempest-TestVolumeSwap-server-1280916315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1280916315',id=16,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxU3FOvhIUFxcuFF/GXGAAhqWLdDNEQbFPDoCM46c2SYRb25E/xpIBPIhSxgFzdS3tNsi7I+U2stPFZ1NfdjbvsMz8jOP822BYaS1BnbHFAsGTnH9sPY0pG9W1922e6gQ==',key_name='tempest-keypair-1457777091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09e5d028d7f14e9898af48f92a1e3649',ramdisk_id='',reservation_id='r-gnksmr6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1869559139',owner_user_name='tempest-TestVolumeSwap-1869559139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3960cc6199469581346258d3da93e4',uuid=b781713b-1c98-4674-901c-a834bf648636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converting VIF {"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG os_vif [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2740900-7120-5fed-bb61-cf17fef9c5bb', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624be246-f0, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap624be246-f0, col_values=(('qos', UUID('1651742b-78c0-436c-9032-1386fa39d6f6')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap624be246-f0, col_values=(('external_ids', {'iface-id': '624be246-f0a3-4448-9c3b-8bfba73e4685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:ab:93', 'vm-uuid': 'b781713b-1c98-4674-901c-a834bf648636'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:36 user nova-compute[74903]: INFO os_vif [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0')
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] No VIF found with MAC fa:16:3e:c6:ab:93, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Updated VIF entry in instance network info cache for port 624be246-f0a3-4448-9c3b-8bfba73e4685. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating instance_info_cache with network_info: [{"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fcf06a90-5f3f-42ff-857c-3bbd0a070dd8 req-1f87a347-7e5b-4879-ade6-8e944ae1a225 service nova] Releasing lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:38 user nova-compute[74903]: WARNING nova.compute.manager [req-c87a0f71-242f-4c44-aad7-adf49e34061a req-0e0a7e3e-c3d7-482f-9713-d5daf80a6627 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state building and task_state spawning.
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:40 user nova-compute[74903]: WARNING nova.compute.manager [req-4906dbc4-185e-4a47-81c2-b96947bddac7 req-83e26991-cf74-4658-914c-770008ba2f17 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state building and task_state spawning.
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:00:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b781713b-1c98-4674-901c-a834bf648636] Instance spawned successfully.
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:00:40 user nova-compute[74903]: INFO nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 06 06:00:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:00:41 user nova-compute[74903]: INFO nova.compute.manager [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Took 7.78 seconds to build instance.
Nov 06 06:00:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4f033dd2-33b2-4059-8e32-5b8c397e8399 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.917s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:50 user nova-compute[74903]: INFO nova.compute.manager [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Rescuing
Nov 06 06:00:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:00:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:00:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:51 user nova-compute[74903]: WARNING nova.compute.manager [req-929a043a-0a59-4f0e-ac5c-79f0d96a0312 req-e7843708-0ce8-4645-8720-794b0f474eec service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state rescuing.
Nov 06 06:00:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance destroyed successfully.
Nov 06 06:00:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Attempting a stable device rescue
Nov 06 06:00:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:00:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Creating image(s)
Nov 06 06:00:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "d016af5da35822464662bc288bc9df416ab204c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "d016af5da35822464662bc288bc9df416ab204c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.part --force-share --output=json" returned: 0 in 0.254s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG nova.virt.images [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] 3d8ccb0d-6139-4cd4-a82f-7c8d43088700 was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.part /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:53 user nova-compute[74903]: WARNING nova.compute.manager [req-02bcae3b-d827-4b47-822e-7f10ccb67f74 req-6a866e9e-0808-4fa2-b693-6735fc11050b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state rescuing.
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.part /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.converted" returned: 0 in 0.268s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "d016af5da35822464662bc288bc9df416ab204c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.945s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "d016af5da35822464662bc288bc9df416ab204c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "d016af5da35822464662bc288bc9df416ab204c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0 --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0,backing_fmt=raw /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0,backing_fmt=raw /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue" returned: 0 in 0.059s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "d016af5da35822464662bc288bc9df416ab204c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'migration_context' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<42720fc5-a750-4108-bd41-f8834bc4edee> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start _get_guest_xml network_info=[{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:6e:f6:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3d8ccb0d-6139-4cd4-a82f-7c8d43088700', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '42720fc5-a750-4108-bd41-f8834bc4edee', 'attached_at': '', 'detached_at': '', 'volume_id': '5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'serial': '5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'dc54d898-b2f6-435c-9737-dc97d597088e', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<42720fc5-a750-4108-bd41-f8834bc4edee> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'numa_topology' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<42720fc5-a750-4108-bd41-f8834bc4edee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<42720fc5-a750-4108-bd41-f8834bc4edee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:54 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:54 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:00:54 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b5887-54b7-4ea2-92e3-4f60857ca621]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GEiDpIQd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 06:00:54 user nova-compute[74903]: node.name = iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:00:54 user nova-compute[74903]: node.tpgt = -1
Nov 06 06:00:54 user nova-compute[74903]: node.startup = automatic
Nov 06 06:00:54 user nova-compute[74903]: node.leading_login = No
Nov 06 06:00:54 user nova-compute[74903]: iface.iscsi_ifacename = default
Nov 06 06:00:54 user nova-compute[74903]: iface.net_ifacename = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.ipaddress = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.prefix_len = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.hwaddress = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.transport_name = tcp
Nov 06 06:00:54 user nova-compute[74903]: iface.initiatorname = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.vlan_id = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.vlan_priority = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.vlan_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.iface_num = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.mtu = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.port = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.bootproto = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.subnet_mask = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.gateway = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_alt_client_id = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_dns = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_learn_iqn = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_vendor_id_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_vendor_id = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.dhcp_slp_da = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.fragmentation = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.gratuitous_arp = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.incoming_forwarding = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.tos_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.tos = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.ttl = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.delayed_ack = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.tcp_nagle = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.tcp_wsf_state = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.tcp_wsf = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.tcp_timer_scale = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.tcp_timestamp = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.redirect = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.def_task_mgmt_timeout = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.header_digest = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.data_digest = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.immediate_data = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.initial_r2t = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.data_seq_inorder = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.data_pdu_inorder = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.erl = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.max_receive_data_len = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.first_burst_len = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.max_outstanding_r2t = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.max_burst_len = 0
Nov 06 06:00:54 user nova-compute[74903]: iface.chap_auth = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.bidi_chap = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.strict_login_compliance = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.discovery_auth = <empty>
Nov 06 06:00:54 user nova-compute[74903]: iface.discovery_logout = <empty>
Nov 06 06:00:54 user nova-compute[74903]: node.discovery_address = <empty>
Nov 06 06:00:54 user nova-compute[74903]: node.discovery_port = 0
Nov 06 06:00:54 user nova-compute[74903]: node.discovery_type = static
Nov 06 06:00:54 user nova-compute[74903]: node.session.initial_cmdsn = 0
Nov 06 06:00:54 user nova-compute[74903]: node.session.initial_login_retry_max = 8
Nov 06 06:00:54 user nova-compute[74903]: node.session.xmit_thread_priority = -20
Nov 06 06:00:54 user nova-compute[74903]: node.session.cmds_max = 128
Nov 06 06:00:54 user nova-compute[74903]: node.session.queue_depth = 32
Nov 06 06:00:54 user nova-compute[74903]: node.session.nr_sessions = 1
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.authmethod = CHAP
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.username = GEiDpIQd
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.password = ***
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.username_in = <empty>
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.password_in = <empty>
Nov 06 06:00:54 user nova-compute[74903]: node.session.auth.chap_algs = MD5
Nov 06 06:00:54 user nova-compute[74903]: node.session.timeo.replacement_timeout = 120
Nov 06 06:00:54 user nova-compute[74903]: node.session.err_timeo.abort_timeout = 15
Nov 06 06:00:54 user nova-compute[74903]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 06:00:54 user nova-compute[74903]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 06:00:54 user nova-compute[74903]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.FastAbort = Yes
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.InitialR2T = No
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.ImmediateData = Yes
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.MaxConnections = 1
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 06:00:54 user nova-compute[74903]: node.session.iscsi.ERL = 0
Nov 06 06:00:54 user nova-compute[74903]: node.session.scan = manual
Nov 06 06:00:54 user nova-compute[74903]: node.session.reopen_max = 0
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].address = 172.16.0.220
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].port = 3260
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].startup = manual
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].tcp.window_size = 524288
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].tcp.type_of_service = 0
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].timeo.logout_timeout = 15
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].timeo.login_timeout = 15
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].timeo.auth_timeout = 45
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.DataDigest = None
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.IFMarker = No
Nov 06 06:00:54 user nova-compute[74903]: node.conn[0].iscsi.OFMarker = No
Nov 06 06:00:54 user nova-compute[74903]: # END RECORD
Nov 06 06:00:54 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d5f56-a80c-434b-acb7-ce3fe521f5eb]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcdcaa3-1e78-49ad-b859-eb458a5c4cc1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEiDpIQd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEiDpIQd" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a840103-db32-42c5-8d38-a5eae9e8d250]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GEiDpIQd'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c84ce-4fb7-430f-950e-ef3fb15ed69b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea54e39e-c193-43b8-828e-2ea21e551270]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:00:54 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:00:54 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.206s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] HCTL ('33', '0', '0', 0) found on session 8 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[204d5c5c-8454-49fc-b060-0869c8530eb5]: (4, ('0 0 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching for a device in session 8 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== connect_volume: return (233ms) {'type': 'block', 'scsi_wwn': '26634623436653066', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634623436653066', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622863304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622863304',id=13,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-rrug10ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T05:59:18Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=42720fc5-a750-4108-bd41-f8834bc4edee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:6e:f6:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:6e:f6:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<42720fc5-a750-4108-bd41-f8834bc4edee> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:00:54 user nova-compute[74903]:   <uuid>42720fc5-a750-4108-bd41-f8834bc4edee</uuid>
Nov 06 06:00:54 user nova-compute[74903]:   <name>instance-0000000d</name>
Nov 06 06:00:54 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:00:54 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:00:54 user nova-compute[74903]:   <metadata>
Nov 06 06:00:54 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:00:54 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1622863304</nova:name>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:00:54</nova:creationTime>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:00:54 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:00:54 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:owner>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 06:00:54 user nova-compute[74903]:       </nova:owner>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:00:54 user nova-compute[74903]:       <nova:ports>
Nov 06 06:00:54 user nova-compute[74903]:         <nova:port uuid="ad661255-20e8-4a90-a42f-3a7d37b4c04d">
Nov 06 06:00:54 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:00:54 user nova-compute[74903]:         </nova:port>
Nov 06 06:00:54 user nova-compute[74903]:       </nova:ports>
Nov 06 06:00:54 user nova-compute[74903]:     </nova:instance>
Nov 06 06:00:54 user nova-compute[74903]:   </metadata>
Nov 06 06:00:54 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:00:54 user nova-compute[74903]:     <system>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="serial">42720fc5-a750-4108-bd41-f8834bc4edee</entry>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="uuid">42720fc5-a750-4108-bd41-f8834bc4edee</entry>
Nov 06 06:00:54 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:00:54 user nova-compute[74903]:     </system>
Nov 06 06:00:54 user nova-compute[74903]:   </sysinfo>
Nov 06 06:00:54 user nova-compute[74903]:   <os>
Nov 06 06:00:54 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:00:54 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:00:54 user nova-compute[74903]:   </os>
Nov 06 06:00:54 user nova-compute[74903]:   <features>
Nov 06 06:00:54 user nova-compute[74903]:     <acpi/>
Nov 06 06:00:54 user nova-compute[74903]:     <apic/>
Nov 06 06:00:54 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:00:54 user nova-compute[74903]:   </features>
Nov 06 06:00:54 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:00:54 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:00:54 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:00:54 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:00:54 user nova-compute[74903]:   </clock>
Nov 06 06:00:54 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:00:54 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:00:54 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:00:54 user nova-compute[74903]:   </cpu>
Nov 06 06:00:54 user nova-compute[74903]:   <devices>
Nov 06 06:00:54 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:00:54 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:00:54 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:00:54 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:00:54 user nova-compute[74903]:       <serial>5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a</serial>
Nov 06 06:00:54 user nova-compute[74903]:     </disk>
Nov 06 06:00:54 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:00:54 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:00:54 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue"/>
Nov 06 06:00:54 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:00:54 user nova-compute[74903]:       <boot order="1"/>
Nov 06 06:00:54 user nova-compute[74903]:     </disk>
Nov 06 06:00:54 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:00:54 user nova-compute[74903]:       <mac address="fa:16:3e:6e:f6:48"/>
Nov 06 06:00:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:54 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:00:54 user nova-compute[74903]:       <target dev="tapad661255-20"/>
Nov 06 06:00:54 user nova-compute[74903]:     </interface>
Nov 06 06:00:54 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:00:54 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/console.log" append="off"/>
Nov 06 06:00:54 user nova-compute[74903]:     </serial>
Nov 06 06:00:54 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:00:54 user nova-compute[74903]:     <video>
Nov 06 06:00:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:00:54 user nova-compute[74903]:     </video>
Nov 06 06:00:54 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:00:54 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:00:54 user nova-compute[74903]:     </rng>
Nov 06 06:00:54 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:00:54 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:00:54 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:00:54 user nova-compute[74903]:     </memballoon>
Nov 06 06:00:54 user nova-compute[74903]:   </devices>
Nov 06 06:00:54 user nova-compute[74903]: </domain>
Nov 06 06:00:54 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:00:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance destroyed successfully.
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'flavor' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:6e:f6:48, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:55 user nova-compute[74903]: INFO nova.compute.manager [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attaching volume 1189533d-fb93-4a26-9488-3427e27f4b53 to /dev/vdb
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.utils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[635b9332-17c0-4166-bc1f-208d311aae21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa2bfcd-73f9-4261-b199-b8c959613c73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d68086a-5058-4be4-be9f-eec622ba9ec6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[837217d3-3290-486e-ab60-8017ab1e4c7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:00:55 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa24c7-1e7a-46be-ab98-7d2d311dd640]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG os_brick.utils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating existing volume attachment record: aec8112b-bee6-4ffd-a52d-e1831fcbffcf {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-changed-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Refreshing instance network info cache due to event network-changed-9033c9b3-0dba-4b46-bea3-5a3b0bf02649. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] Acquiring lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] Acquired lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:00:55 user nova-compute[74903]: DEBUG nova.network.neutron [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Refreshing network info cache for port 9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updated VIF entry in instance network info cache for port 9033c9b3-0dba-4b46-bea3-5a3b0bf02649. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating instance_info_cache with network_info: [{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:00:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03bda93e-d6dd-414c-a443-9b54ae33b0c9 req-d9cebc55-5eb3-46cc-b674-4a25ce8df6c8 service nova] Releasing lock "refresh_cache-dee138d4-059b-489d-8122-cbb4b2c2112e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:00:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:58 user nova-compute[74903]: WARNING nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state rescuing.
Nov 06 06:00:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:00:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:00:58 user nova-compute[74903]: WARNING nova.compute.manager [req-36dd9253-a49b-43f2-96ec-de8d2d653c14 req-ce02cb87-289f-496a-a060-721c95357390 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state rescuing.
Nov 06 06:00:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0f599928-61f2-42dd-be0d-8e173ca65f0b tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:01:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-changed-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing instance network info cache due to event network-changed-41646a38-a4db-4ca6-bf7e-1dc23226895f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:01:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] Acquiring lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] Acquired lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:02 user nova-compute[74903]: DEBUG nova.network.neutron [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Refreshing network info cache for port 41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:01:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updated VIF entry in instance network info cache for port 41646a38-a4db-4ca6-bf7e-1dc23226895f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:01:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a21e096e-10f2-4c0b-9768-6e814d095b2e req-1a7b5a6c-28c0-4191-bba2-f11c7c865657 service nova] Releasing lock "refresh_cache-f7993894-5fb4-4f9f-ac9f-85afdf95993a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:07 user nova-compute[74903]: INFO nova.compute.manager [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Terminating instance
Nov 06 06:01:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-b6804424-dcf2-40f5-b394-08f8bab2de77 req-7c25a39f-f392-460d-a5f7-5514bc557f9b service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8696d9e-a65c-4c99-94f9-45bd0565d407 req-075539c4-32a3-4b91-b18c-a8ed2e89577f service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-f882adc1-0815-4977-9b82-bcfbb03ce30b for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Instance destroyed successfully.
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lazy-loading 'resources' on Instance uuid f7993894-5fb4-4f9f-ac9f-85afdf95993a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41646a38-a4, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=317f3922-7824-4929-abd0-2707a74f94cb) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=41646a38-a4db-4ca6-bf7e-1dc23226895f,network=Network(b4b70db5-f0c0-4955-a3ff-cf05df9712b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41646a38-a4')
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf7ef72e-bf, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d38df371-167c-4541-92eb-35a5d813f2ec) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:16:b4,bridge_name='br-int',has_traffic_filtering=True,id=bf7ef72e-bf3a-47df-894a-2fcab391d313,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbf7ef72e-bf')
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c3693dc-a0, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6681bbb-ef8d-436d-a4d4-7adfc6e09ebc) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:82:65,bridge_name='br-int',has_traffic_filtering=True,id=0c3693dc-a0af-46af-9b72-68ecc6d5254d,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0c3693dc-a0')
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap734d3dde-05, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38d181ff-d088-4415-ace7-92f92041ed4a) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:71:7b,bridge_name='br-int',has_traffic_filtering=True,id=734d3dde-050e-4cb9-85f2-c01641898cdb,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap734d3dde-05')
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb750304d-43, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c197cac-3860-44b4-9d9f-960191c50da7) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:fb:63,bridge_name='br-int',has_traffic_filtering=True,id=b750304d-4335-4a4d-b9d6-1ac5c20e0fe6,network=Network(78c66800-5353-47a3-858b-297215a22de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb750304d-43')
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "d6e82787-dae3-4353-8541-ce24b080e154", "address": "fa:16:3e:ff:4a:cb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e82787-da", "ovs_interfaceid": "d6e82787-dae3-4353-8541-ce24b080e154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6e82787-da, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82a77af3-1cd5-4b3c-86f4-5ae1b3521de3) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4a:cb,bridge_name='br-int',has_traffic_filtering=True,id=d6e82787-dae3-4353-8541-ce24b080e154,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e82787-da')
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T05:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-529108490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-529108490',id=14,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf15i7Gcn7CEKUgDhR+j3UqUmsXo1CP/4hYY3HZo0w15akWxnmatl99zSsUQxOJn3wYOFsFm9dEYwL/BETTu0vOMu0MYu7jdJhZR3m8RNFw1pHE4iSS1DcwBBi2+wRvlA==',key_name='tempest-keypair-851546443',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1cb0f6959fa4b9e869f688933b80d82',ramdisk_id='',reservation_id='r-xrr1grfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-162766746',owner_user_name='tempest-TaggedBootDevicesTest_v242-162766746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c7b2dde4a64ce3a23a67df5423a16e',uuid=f7993894-5fb4-4f9f-ac9f-85afdf95993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converting VIF {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf882adc1-08, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c361496-d622-4d6d-bc8e-67184b8a9378) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: INFO os_vif [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:1c:bb,bridge_name='br-int',has_traffic_filtering=True,id=f882adc1-0815-4977-9b82-bcfbb03ce30b,network=Network(655a84a9-abd3-413e-ab35-3bbd8d14a836),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf882adc1-08')
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbkIVWuJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:10 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b6d80c-d20a-4fa8-aa9d-51c23c67b55e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]: iSNS:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]: STATIC:
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: FIRMWARE:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:01:10 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:01:10 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[834aa021-4603-46ab-aa25-a9278d1beffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d69f93-5f8c-4f0f-ab78-c91ddd16ebdf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087bdea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[912156ac-7b45-40a2-86a3-0f78a9b52010]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77fd26-3af1-4eb3-a367-fc1eb0174e8a]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[548f1103-e980-4582-833a-9f7ff16f88bb]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7bbb4f-bde9-43e3-85e6-1573ead2ee35]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca88245-fbe9-477f-89f6-2d08ef68bd7b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e69a03-4386-4b6b-9f2f-ad43d3bbba49]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260]
Nov 06 06:01:10 user nova-compute[74903]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8, portal: 172.16.0.220,3260] successful.
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36ab9587-36a8-43b3-8a92-a64dce74eeb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455c0a0-b986-481d-81d7-d77d1e976a73]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== disconnect_volume: return (449ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:10 user nova-compute[74903]: WARNING nova.compute.manager [req-24baa29a-67e3-4947-ad3c-74373ec6da5e req-3c0665ea-37f4-405d-911b-ede76fb2775c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 for instance with vm_state active and task_state deleting.
Nov 06 06:01:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkLbNZTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:10 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6faf414-b88b-4a08-955c-92334979e2cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]: iSNS:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]: STATIC:
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:01:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:10 user nova-compute[74903]: FIRMWARE:
Nov 06 06:01:10 user nova-compute[74903]: No targets found.
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:01:10 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:01:10 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4d7fea-0ee8-4326-a540-e0f1e43727c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json" returned: 0 in 0.284s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f831cd6d-6c1d-4432-94ba-60a06b3ecce7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:10 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085ff130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6'): ({'sdg'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Removing single pathed devices sdg {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79feb43-7810-45a7-8871-b179949782a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1b6f5-7ad4-4042-a5c3-224c28ddf4ac]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Flushing IO for device /dev/sdg {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de40a21-1b31-44ba-8378-f5fa321e7f87]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.063s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d9ba0-7b70-40c2-a175-bdb5206dd3aa]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85e1d3-c6ec-406b-afee-5e26c94800ff]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:11 user nova-compute[74903]: WARNING nova.compute.manager [req-8e4907d0-0859-41c8-b120-644f6dde3907 req-aa9ea459-b9bc-44ed-b997-66ba90266f66 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-f882adc1-0815-4977-9b82-bcfbb03ce30b for instance with vm_state active and task_state deleting.
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38b1c6e-7193-42e4-93e6-d4382bb46819]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260]
Nov 06 06:01:11 user nova-compute[74903]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6, portal: 172.16.0.220,3260] successful.
Nov 06 06:01:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be243b7c-c47d-448f-bf28-3732328c00c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb430b-3317-48d0-a67f-bec0056c719f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== disconnect_volume: return (480ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DwCJKlSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:11 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac18d9-6498-443b-9e23-2f165ef67a0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:01:11 user nova-compute[74903]: No targets found.
Nov 06 06:01:11 user nova-compute[74903]: iSNS:
Nov 06 06:01:11 user nova-compute[74903]: No targets found.
Nov 06 06:01:11 user nova-compute[74903]: STATIC:
Nov 06 06:01:11 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:01:11 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:11 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:11 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:01:11 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:11 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:11 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151
Nov 06 06:01:11 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:11 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:11 user nova-compute[74903]: FIRMWARE:
Nov 06 06:01:11 user nova-compute[74903]: No targets found.
Nov 06 06:01:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:01:11 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:01:11 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d9b30-c564-47fa-be24-968a6ccec360]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26f9f6-658e-413e-a21e-5e66af6771cb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:11 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:11 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 (non-flash)
Nov 06 06:01:11 user nova-compute[74903]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:11 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa286291b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151'): ({'sdh'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Removing single pathed devices sdh {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b8b8c2-5fab-47c3-9da3-f7b50c4cc470]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc49e596-0b22-4e1f-bbe9-90887266f88f]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Flushing IO for device /dev/sdh {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d61456-f5b4-4d6b-8d1b-02782bd1f53b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea3cc46-311b-4d46-990d-0d2802c9da63]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] SCSI volumes sdh have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9bffd-2989-4acc-89ec-c21bd46bd2e0]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaba773f-ec98-49fc-8b39-e570b9b00d2f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260]
Nov 06 06:01:11 user nova-compute[74903]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151, portal: 172.16.0.220,3260] successful.
Nov 06 06:01:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8387f9d7-9d83-4bed-8aca-e8f701d03151 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ede221-9f52-45a2-b9b7-0d1d9f09ac20]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] <== disconnect_volume: return (451ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:01:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Deleting instance files /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a_del
Nov 06 06:01:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Deletion of /opt/stack/data/nova/instances/f7993894-5fb4-4f9f-ac9f-85afdf95993a_del complete
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:11 user nova-compute[74903]: INFO nova.compute.manager [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Took 4.25 seconds to destroy the instance on the hypervisor.
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-63de49c4-37ba-428b-ab60-5883107c5464 req-284448ea-b95c-468d-9a08-0298a356c816 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-41646a38-a4db-4ca6-bf7e-1dc23226895f for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'f7993894-5fb4-4f9f-ac9f-85afdf95993a' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f7993894-5fb4-4f9f-ac9f-85afdf95993a' (instance-0000000e)
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json" returned: 0 in 0.236s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: WARNING nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-41646a38-a4db-4ca6-bf7e-1dc23226895f for instance with vm_state active and task_state deleting.
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: WARNING nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-bf7ef72e-bf3a-47df-894a-2fcab391d313 for instance with vm_state active and task_state deleting.
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: WARNING nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-0c3693dc-a0af-46af-9b72-68ecc6d5254d for instance with vm_state active and task_state deleting.
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-734d3dde-050e-4cb9-85f2-c01641898cdb for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:14 user nova-compute[74903]: WARNING nova.compute.manager [req-cd748f26-341d-410c-919e-11a08cd49717 req-400923be-2f79-4c09-bb51-2a732acfe6de service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-734d3dde-050e-4cb9-85f2-c01641898cdb for instance with vm_state active and task_state deleting.
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-e2275829-61fd-43e0-8856-7d539cdbb053 req-87356657-7cc0-4d71-9eba-55b2390c407c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-deleted-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:15 user nova-compute[74903]: INFO nova.compute.manager [req-e2275829-61fd-43e0-8856-7d539cdbb053 req-87356657-7cc0-4d71-9eba-55b2390c407c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Neutron deleted interface d6e82787-dae3-4353-8541-ce24b080e154; detaching it from the instance and deleting it from the info cache
Nov 06 06:01:15 user nova-compute[74903]: DEBUG nova.network.neutron [req-e2275829-61fd-43e0-8856-7d539cdbb053 req-87356657-7cc0-4d71-9eba-55b2390c407c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "734d3dde-050e-4cb9-85f2-c01641898cdb", "address": "fa:16:3e:1f:71:7b", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap734d3dde-05", "ovs_interfaceid": "734d3dde-050e-4cb9-85f2-c01641898cdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-e2275829-61fd-43e0-8856-7d539cdbb053 req-87356657-7cc0-4d71-9eba-55b2390c407c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Detach interface failed, port_id=d6e82787-dae3-4353-8541-ce24b080e154, reason: Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7544MB free_disk=25.44623565673828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-unplugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-unplugged-d6e82787-dae3-4353-8541-ce24b080e154 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Acquiring lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] No waiting events found dispatching network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:16 user nova-compute[74903]: WARNING nova.compute.manager [req-b4013509-3922-46b1-b457-1d829664a1ec req-9ac37094-c2b8-425b-8f04-78ae79913dd1 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received unexpected event network-vif-plugged-d6e82787-dae3-4353-8541-ce24b080e154 for instance with vm_state active and task_state deleting.
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:01:16 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-deleted-734d3dde-050e-4cb9-85f2-c01641898cdb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:17 user nova-compute[74903]: INFO nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Neutron deleted interface 734d3dde-050e-4cb9-85f2-c01641898cdb; detaching it from the instance and deleting it from the info cache
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "address": "fa:16:3e:6c:1c:bb", "network": {"id": "655a84a9-abd3-413e-ab35-3bbd8d14a836", "bridge": "br-int", "label": "tempest-device-tagging-net2-1309201629", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf882adc1-08", "ovs_interfaceid": "f882adc1-0815-4977-9b82-bcfbb03ce30b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Detach interface failed, port_id=734d3dde-050e-4cb9-85f2-c01641898cdb, reason: Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-deleted-f882adc1-0815-4977-9b82-bcfbb03ce30b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:17 user nova-compute[74903]: INFO nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Neutron deleted interface f882adc1-0815-4977-9b82-bcfbb03ce30b; detaching it from the instance and deleting it from the info cache
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [{"id": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "address": "fa:16:3e:d8:a6:88", "network": {"id": "b4b70db5-f0c0-4955-a3ff-cf05df9712b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-579810525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41646a38-a4", "ovs_interfaceid": "41646a38-a4db-4ca6-bf7e-1dc23226895f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "address": "fa:16:3e:66:16:b4", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf7ef72e-bf", "ovs_interfaceid": "bf7ef72e-bf3a-47df-894a-2fcab391d313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "address": "fa:16:3e:ed:82:65", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.116", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3693dc-a0", "ovs_interfaceid": "0c3693dc-a0af-46af-9b72-68ecc6d5254d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "address": "fa:16:3e:3a:fb:63", "network": {"id": "78c66800-5353-47a3-858b-297215a22de4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1414318297", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1cb0f6959fa4b9e869f688933b80d82", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb750304d-43", "ovs_interfaceid": "b750304d-4335-4a4d-b9d6-1ac5c20e0fe6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-af43a2c6-f0bb-462f-aaa0-9066eca8169a req-3fd68a1d-bd05-4c86-b682-0a32c32c0d80 service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Detach interface failed, port_id=f882adc1-0815-4977-9b82-bcfbb03ce30b, reason: Instance f7993894-5fb4-4f9f-ac9f-85afdf95993a could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:01:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:19 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Took 7.27 seconds to deallocate network for instance.
Nov 06 06:01:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-1804cc8c-8879-4410-8c4e-71b6cfdff64a req-043f9c5c-8672-4bf5-a9de-41309c92c77c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-deleted-b750304d-4335-4a4d-b9d6-1ac5c20e0fe6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-1804cc8c-8879-4410-8c4e-71b6cfdff64a req-043f9c5c-8672-4bf5-a9de-41309c92c77c service nova] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Received event network-vif-deleted-41646a38-a4db-4ca6-bf7e-1dc23226895f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:01:21 user nova-compute[74903]: INFO nova.compute.claims [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Claim successful on node user
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:01:21 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.policy [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b72fa5945c34f89a8e3c554f0cfac13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce1a98b600f441ba91bca64ad194e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:01:21 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Creating image(s)
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "/opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "/opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "/opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.221s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk 1073741824" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:22 user nova-compute[74903]: INFO nova.compute.manager [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] [instance: f7993894-5fb4-4f9f-ac9f-85afdf95993a] Took 3.58 seconds to detach 3 volumes for instance.
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Cannot resize image /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Ensure instance console log exists: /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Successfully created port: a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:23 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Deleted allocations for instance f7993894-5fb4-4f9f-ac9f-85afdf95993a
Nov 06 06:01:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fc67f113-4fb3-4af0-9548-f538ffd6a585 tempest-TaggedBootDevicesTest_v242-162766746 tempest-TaggedBootDevicesTest_v242-162766746-project-member] Lock "f7993894-5fb4-4f9f-ac9f-85afdf95993a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.009s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Successfully updated port: a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-changed-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Refreshing instance network info cache due to event network-changed-a140e256-f8be-4d67-b38e-5832d2a6e650. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] Acquiring lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] Acquired lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.network.neutron [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Refreshing network info cache for port a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:23 user nova-compute[74903]: DEBUG nova.network.neutron [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-89107fa6-7cbd-4703-8707-84ed8a4c43fd req-f8e20309-f3e6-45f6-a144-1f21a89490b9 service nova] Releasing lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquired lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating instance_info_cache with network_info: [{"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Releasing lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance network_info: |[{"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Start _get_guest_xml network_info=[{"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:01:24 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:24 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847509246',display_name='tempest-SnapshotDataIntegrityTests-server-1847509246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847509246',id=17,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImVYh0TdOY9geuIz0tsh0pqo8VLmdthZiXW9e6boHOcRufzhq4oG0Zr3o2FgRGcj9ar4sdSZsnUrEP6S0c+8IxvC7z8zOgDImSpumzkgQl6cfX7qYIj17ArxlKI6bT87w==',key_name='tempest-keypair-1221083766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce1a98b600f441ba91bca64ad194e4b6',ramdisk_id='',reservation_id='r-lmia2k6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2107137012',owner_user_name='tempest-SnapshotDataIntegrityTests-2107137012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b72fa5945c34f89a8e3c554f0cfac13',uuid=8239a418-b65a-4d4f-95dd-efe0e836403a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converting VIF {"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'pci_devices' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:01:24 user nova-compute[74903]:   <uuid>8239a418-b65a-4d4f-95dd-efe0e836403a</uuid>
Nov 06 06:01:24 user nova-compute[74903]:   <name>instance-00000011</name>
Nov 06 06:01:24 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:01:24 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:01:24 user nova-compute[74903]:   <metadata>
Nov 06 06:01:24 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:01:24 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1847509246</nova:name>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:01:24</nova:creationTime>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:01:24 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:01:24 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:owner>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:user uuid="0b72fa5945c34f89a8e3c554f0cfac13">tempest-SnapshotDataIntegrityTests-2107137012-project-member</nova:user>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:project uuid="ce1a98b600f441ba91bca64ad194e4b6">tempest-SnapshotDataIntegrityTests-2107137012</nova:project>
Nov 06 06:01:24 user nova-compute[74903]:       </nova:owner>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:01:24 user nova-compute[74903]:       <nova:ports>
Nov 06 06:01:24 user nova-compute[74903]:         <nova:port uuid="a140e256-f8be-4d67-b38e-5832d2a6e650">
Nov 06 06:01:24 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 06:01:24 user nova-compute[74903]:         </nova:port>
Nov 06 06:01:24 user nova-compute[74903]:       </nova:ports>
Nov 06 06:01:24 user nova-compute[74903]:     </nova:instance>
Nov 06 06:01:24 user nova-compute[74903]:   </metadata>
Nov 06 06:01:24 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:01:24 user nova-compute[74903]:     <system>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="serial">8239a418-b65a-4d4f-95dd-efe0e836403a</entry>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="uuid">8239a418-b65a-4d4f-95dd-efe0e836403a</entry>
Nov 06 06:01:24 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:01:24 user nova-compute[74903]:     </system>
Nov 06 06:01:24 user nova-compute[74903]:   </sysinfo>
Nov 06 06:01:24 user nova-compute[74903]:   <os>
Nov 06 06:01:24 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:01:24 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:01:24 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:01:24 user nova-compute[74903]:   </os>
Nov 06 06:01:24 user nova-compute[74903]:   <features>
Nov 06 06:01:24 user nova-compute[74903]:     <acpi/>
Nov 06 06:01:24 user nova-compute[74903]:     <apic/>
Nov 06 06:01:24 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:01:24 user nova-compute[74903]:   </features>
Nov 06 06:01:24 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:01:24 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:01:24 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:01:24 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:01:24 user nova-compute[74903]:   </clock>
Nov 06 06:01:24 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:01:24 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:01:24 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:01:24 user nova-compute[74903]:   </cpu>
Nov 06 06:01:24 user nova-compute[74903]:   <devices>
Nov 06 06:01:24 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:01:24 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:01:24 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk"/>
Nov 06 06:01:24 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:01:24 user nova-compute[74903]:     </disk>
Nov 06 06:01:24 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:01:24 user nova-compute[74903]:       <mac address="fa:16:3e:8a:34:7f"/>
Nov 06 06:01:24 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:01:24 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:01:24 user nova-compute[74903]:       <target dev="tapa140e256-f8"/>
Nov 06 06:01:24 user nova-compute[74903]:     </interface>
Nov 06 06:01:24 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:01:24 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/console.log" append="off"/>
Nov 06 06:01:24 user nova-compute[74903]:     </serial>
Nov 06 06:01:24 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:01:24 user nova-compute[74903]:     <video>
Nov 06 06:01:24 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:01:24 user nova-compute[74903]:     </video>
Nov 06 06:01:24 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:01:24 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:01:24 user nova-compute[74903]:     </rng>
Nov 06 06:01:24 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:01:24 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:01:24 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:01:24 user nova-compute[74903]:     </memballoon>
Nov 06 06:01:24 user nova-compute[74903]:   </devices>
Nov 06 06:01:24 user nova-compute[74903]: </domain>
Nov 06 06:01:24 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847509246',display_name='tempest-SnapshotDataIntegrityTests-server-1847509246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847509246',id=17,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImVYh0TdOY9geuIz0tsh0pqo8VLmdthZiXW9e6boHOcRufzhq4oG0Zr3o2FgRGcj9ar4sdSZsnUrEP6S0c+8IxvC7z8zOgDImSpumzkgQl6cfX7qYIj17ArxlKI6bT87w==',key_name='tempest-keypair-1221083766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce1a98b600f441ba91bca64ad194e4b6',ramdisk_id='',reservation_id='r-lmia2k6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2107137012',owner_user_name='tempest-SnapshotDataIntegrityTests-2107137012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b72fa5945c34f89a8e3c554f0cfac13',uuid=8239a418-b65a-4d4f-95dd-efe0e836403a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converting VIF {"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_vif [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73d80efb-a828-59dc-ad35-c9413c72cce0', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa140e256-f8, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa140e256-f8, col_values=(('qos', UUID('b1d4ef92-8382-4119-b461-77bc241b1685')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa140e256-f8, col_values=(('external_ids', {'iface-id': 'a140e256-f8be-4d67-b38e-5832d2a6e650', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:34:7f', 'vm-uuid': '8239a418-b65a-4d4f-95dd-efe0e836403a'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:24 user nova-compute[74903]: INFO os_vif [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8')
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] No VIF found with MAC fa:16:3e:8a:34:7f, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:24 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:24 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:24 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdfc70d-0542-4d02-893a-e7fd63eb6fab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:01:24 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a8aec-0d2d-4ada-a8e7-99e51dd56b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53] added
Nov 06 06:01:24 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf77198-f3d9-4dc7-abb3-7ed54b313ce1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[495a20a1-72f3-4789-837f-fc1e8281a7e1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXdTPGYF {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXdTPGYF" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf52ec9-98a9-4118-90e2-98d8f15980c8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXdTPGYF'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a3e2a-9bcd-4e72-a766-73c3262e131f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1385748-25d6-4928-ac07-0baffbf95d71]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:25 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:25 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f7fd0f-dae1-4c2c-a0a5-7566f771198a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]
Nov 06 06:01:25 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.
Nov 06 06:01:25 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd5a8f-4b93-4d34-95cc-e5779ccea8aa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163e7e2-de65-4bf6-b18d-c2607810328c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:25 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:01:25 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:25 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[462728c8-b6e4-47a2-89bf-1146772d0309]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26130373664666336', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130373664666336', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] No waiting events found dispatching network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:26 user nova-compute[74903]: WARNING nova.compute.manager [req-40ae85e9-efa9-4c20-8d75-dae2b510cc80 req-491f5b80-58a6-4522-ba63-6c34f36a79f9 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received unexpected event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 for instance with vm_state building and task_state spawning.
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'flavor' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:01:26 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:01:26 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:01:26 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:01:26 user nova-compute[74903]:   <serial>1189533d-fb93-4a26-9488-3427e27f4b53</serial>
Nov 06 06:01:26 user nova-compute[74903]: </disk>
Nov 06 06:01:26 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:2f:b5:21, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:01:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c97faf7c-3f31-4fd6-8d32-eb2d637d4c7e tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.746s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] No waiting events found dispatching network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:28 user nova-compute[74903]: WARNING nova.compute.manager [req-78642110-9297-4bcf-995b-1e7b77529aed req-1f6f5d5a-cf75-4d5d-9e78-81d59ca2c615 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received unexpected event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 for instance with vm_state building and task_state spawning.
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:01:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance spawned successfully.
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:28 user nova-compute[74903]: INFO nova.compute.manager [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Rebuilding instance
Nov 06 06:01:28 user nova-compute[74903]: INFO nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:01:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:01:29 user nova-compute[74903]: INFO nova.compute.manager [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Took 8.03 seconds to build instance.
Nov 06 06:01:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d8da76c8-a8a0-4f98-a927-b94bc7ee3164 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.172s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:29 user nova-compute[74903]: WARNING nova.compute.manager [req-e5e0ff1b-995c-48f7-9e82-cf4facc81a09 req-9034af5b-89e5-44ab-8ab5-68a28d22301e service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state active and task_state rebuilding.
Nov 06 06:01:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance destroyed successfully.
Nov 06 06:01:30 user nova-compute[74903]: INFO nova.compute.manager [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Detaching volume 1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:01:30 user nova-compute[74903]: INFO nova.virt.block_device [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attempting to driver detach volume 1189533d-fb93-4a26-9488-3427e27f4b53 from mountpoint /dev/vdb
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Attempting to detach device vdb from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:01:30 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:01:30 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:01:30 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:01:30 user nova-compute[74903]:   <serial>1189533d-fb93-4a26-9488-3427e27f4b53</serial>
Nov 06 06:01:30 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:01:30 user nova-compute[74903]: </disk>
Nov 06 06:01:30 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:01:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully detached device vdb from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the persistent domain config.
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde3874-76a0-4224-81fe-96b7a2fe18ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:01:30 user nova-compute[74903]: No targets found.
Nov 06 06:01:30 user nova-compute[74903]: iSNS:
Nov 06 06:01:30 user nova-compute[74903]: No targets found.
Nov 06 06:01:30 user nova-compute[74903]: STATIC:
Nov 06 06:01:30 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:01:30 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:30 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:30 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:01:30 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:30 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:30 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:01:30 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:30 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:30 user nova-compute[74903]: FIRMWARE:
Nov 06 06:01:30 user nova-compute[74903]: No targets found.
Nov 06 06:01:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:01:30 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:01:30 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea519d9-e218-4050-9d69-9f3aa349864b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3699d2-08a9-457a-bf88-511a553d6784]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:30 user nova-compute[74903]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:01:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:30 user nova-compute[74903]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:01:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087ca680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa2483-37a1-4aab-8035-f97448019b21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0100b1e-d4ce-4880-ad2b-0410f258be7a]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718cd4a-5780-4bc6-bdd8-879459c25278]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:01:30 user nova-compute[74903]: INFO nova.compute.claims [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Claim successful on node user
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7fb797-5a96-4c72-b9b9-3d8fbcbc7095]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd1f06-f40f-4210-9860-de7281c2d844]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf2d6a6-19ed-417c-b02f-e6e636ce7d91]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]
Nov 06 06:01:30 user nova-compute[74903]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.
Nov 06 06:01:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983a24e-7d4c-42dc-bfbe-656ca22af342]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== disconnect_volume: return (402ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:01:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:01:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:31 user nova-compute[74903]: WARNING nova.compute.manager [req-4bc15ad5-622d-402e-883d-1e095397e1fa req-0b337cae-f4d4-4ab2-82e6-ae1ac05374e8 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state active and task_state rebuilding.
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.policy [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5df2a7857d124d31b806d45b3129a884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d9a876d7e4959b411546efc318ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:01:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Creating image(s)
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk 1073741824" returned: 0 in 0.051s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Successfully created port: be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Cannot resize image /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Ensure instance console log exists: /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Successfully updated port: be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-changed-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing instance network info cache due to event network-changed-be91300f-ea64-409f-a8c0-597d0d8fdf58. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:01:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance destroyed successfully.
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-ServerActionsTestOtherA-server-580424261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9033c9b3-0d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b478f4e-b70b-4bd1-8fad-eaf88ea857ee) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: INFO os_vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d')
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:33 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea924f25-6975-4b0d-932d-1736c9a1d729]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:01:33 user nova-compute[74903]: No targets found.
Nov 06 06:01:33 user nova-compute[74903]: iSNS:
Nov 06 06:01:33 user nova-compute[74903]: No targets found.
Nov 06 06:01:33 user nova-compute[74903]: STATIC:
Nov 06 06:01:33 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:01:33 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:33 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:33 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:01:33 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:01:33 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:01:33 user nova-compute[74903]: FIRMWARE:
Nov 06 06:01:33 user nova-compute[74903]: No targets found.
Nov 06 06:01:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:01:33 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:01:33 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44a93b-28af-4354-a7c3-8132c99f5bcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f0ead-fc1f-4ae6-a7ef-084990c24dd1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:01:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:01:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa285dac20>, {}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Disconnecting from: [] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== disconnect_volume: return (106ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:01:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Deleting instance files /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e_del
Nov 06 06:01:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Deletion of /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e_del complete
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Instance network_info: |[{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing network info cache for port be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Start _get_guest_xml network_info=[{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:01:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:01:33 user nova-compute[74903]:   <uuid>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</uuid>
Nov 06 06:01:33 user nova-compute[74903]:   <name>instance-00000012</name>
Nov 06 06:01:33 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:01:33 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:01:33 user nova-compute[74903]:   <metadata>
Nov 06 06:01:33 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:01:33 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:01:33</nova:creationTime>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:01:33 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:01:33 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:owner>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:01:33 user nova-compute[74903]:       </nova:owner>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:01:33 user nova-compute[74903]:       <nova:ports>
Nov 06 06:01:33 user nova-compute[74903]:         <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:01:33 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:01:33 user nova-compute[74903]:         </nova:port>
Nov 06 06:01:33 user nova-compute[74903]:       </nova:ports>
Nov 06 06:01:33 user nova-compute[74903]:     </nova:instance>
Nov 06 06:01:33 user nova-compute[74903]:   </metadata>
Nov 06 06:01:33 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:01:33 user nova-compute[74903]:     <system>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="serial">5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="uuid">5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:01:33 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:01:33 user nova-compute[74903]:     </system>
Nov 06 06:01:33 user nova-compute[74903]:   </sysinfo>
Nov 06 06:01:33 user nova-compute[74903]:   <os>
Nov 06 06:01:33 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:01:33 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:01:33 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:01:33 user nova-compute[74903]:   </os>
Nov 06 06:01:33 user nova-compute[74903]:   <features>
Nov 06 06:01:33 user nova-compute[74903]:     <acpi/>
Nov 06 06:01:33 user nova-compute[74903]:     <apic/>
Nov 06 06:01:33 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:01:33 user nova-compute[74903]:   </features>
Nov 06 06:01:33 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:01:33 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:01:33 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:01:33 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:01:33 user nova-compute[74903]:   </clock>
Nov 06 06:01:33 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:01:33 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:01:33 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:01:33 user nova-compute[74903]:   </cpu>
Nov 06 06:01:33 user nova-compute[74903]:   <devices>
Nov 06 06:01:33 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:01:33 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:01:33 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk"/>
Nov 06 06:01:33 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:01:33 user nova-compute[74903]:     </disk>
Nov 06 06:01:33 user nova-compute[74903]:     <disk type="file" device="cdrom">
Nov 06 06:01:33 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 06:01:33 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config"/>
Nov 06 06:01:33 user nova-compute[74903]:       <target dev="hda" bus="ide"/>
Nov 06 06:01:33 user nova-compute[74903]:     </disk>
Nov 06 06:01:33 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:01:33 user nova-compute[74903]:       <mac address="fa:16:3e:1b:a5:de"/>
Nov 06 06:01:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:01:33 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:01:33 user nova-compute[74903]:       <target dev="tapbe91300f-ea"/>
Nov 06 06:01:33 user nova-compute[74903]:     </interface>
Nov 06 06:01:33 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:01:33 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log" append="off"/>
Nov 06 06:01:33 user nova-compute[74903]:     </serial>
Nov 06 06:01:33 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:01:33 user nova-compute[74903]:     <video>
Nov 06 06:01:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:01:33 user nova-compute[74903]:     </video>
Nov 06 06:01:33 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:01:33 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:01:33 user nova-compute[74903]:     </rng>
Nov 06 06:01:33 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:01:33 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:01:33 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:01:33 user nova-compute[74903]:     </memballoon>
Nov 06 06:01:33 user nova-compute[74903]:   </devices>
Nov 06 06:01:33 user nova-compute[74903]: </domain>
Nov 06 06:01:33 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_vif [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1590bb89-7803-57d2-b2f2-adc64c8c15ff', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: INFO nova.virt.block_device [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Booting with volume 1189533d-fb93-4a26-9488-3427e27f4b53 at /dev/vdb
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe91300f-ea, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe91300f-ea, col_values=(('qos', UUID('f9230fc0-cc6c-4faf-a681-6c064196241d')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe91300f-ea, col_values=(('external_ids', {'iface-id': 'be91300f-ea64-409f-a8c0-597d0d8fdf58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:a5:de', 'vm-uuid': '5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:33 user nova-compute[74903]: INFO os_vif [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea')
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name hda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No VIF found with MAC fa:16:3e:1b:a5:de, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:01:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Using config drive
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.utils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6ed12-62b0-49f5-8d4a-80eb69d7d2ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026449e-1533-4492-b7f2-439e560a36d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73924f0d-6f29-4318-a404-88ccd18f9793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef80e49-2f7c-4dc4-b7ca-9e4817c90b55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:01:33 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:01:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce775f7-5384-4be8-ba83-7d4de7f3c1db]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG os_brick.utils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:01:33 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating existing volume attachment record: 3892fd5c-212a-4dc7-af95-a5553445013d {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:01:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Creating config drive at /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config
Nov 06 06:01:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2s07tbpf {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:01:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2s07tbpf" returned: 0 in 0.064s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:01:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updated VIF entry in instance network info cache for port be91300f-ea64-409f-a8c0-597d0d8fdf58. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:01:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c385ab92-8e75-4887-ada5-5946ccbd5a52 req-ad5506d0-7935-4790-82d6-7d941841072b service nova] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:36 user nova-compute[74903]: WARNING nova.compute.manager [req-35abed6b-7613-416e-b3b8-523a37b51b09 req-1ce44cef-facf-4e51-9446-2fe7d2954d4d service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 for instance with vm_state building and task_state spawning.
Nov 06 06:01:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:01:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Instance spawned successfully.
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:38 user nova-compute[74903]: WARNING nova.compute.manager [req-57fc5334-312f-404d-89d6-435ef16e5cf6 req-81fd16bd-fc88-47b5-a6e3-6cbd4b6cfb05 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 for instance with vm_state building and task_state spawning.
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:01:38 user nova-compute[74903]: INFO nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 06 06:01:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:01:38 user nova-compute[74903]: INFO nova.compute.manager [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Took 7.77 seconds to build instance.
Nov 06 06:01:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5a4fff3b-7626-465c-b80b-90db4db17f78 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.894s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:01:47 user nova-compute[74903]: WARNING nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 62b2e140-f082-47b9-8347-25ad5123e39e {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 00426b5a-c105-48da-ab5f-82f04a4dd090 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: INFO nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:51 user nova-compute[74903]: INFO nova.compute.manager [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Unrescuing
Nov 06 06:01:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'flavor' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:52 user nova-compute[74903]: WARNING nova.compute.manager [req-2d5d6957-6749-4726-a076-d264ac9d2c88 req-57dd2f11-12dd-4bf9-b241-4a268f6a19f7 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:01:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance destroyed successfully.
Nov 06 06:01:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:54 user nova-compute[74903]: WARNING nova.compute.manager [req-1c2a8443-f3d0-4aea-98e2-e32d26889d44 req-0169b1ff-887d-49bc-bdf3-ad1d7efa3205 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:01:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:56 user nova-compute[74903]: WARNING nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:01:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:01:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:01:56 user nova-compute[74903]: WARNING nova.compute.manager [req-1d4dbdbb-ab21-4c41-8161-1197ca856005 req-75a6a29d-440b-42f6-9622-f8f50f9c5916 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:01:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07ddbbf4-3687-4f62-a250-b8d4bbff7e6d tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:01:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:02:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:02:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Creating image(s)
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk 1073741824" returned: 0 in 0.106s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.226s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Cannot resize image /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:02:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Ensure instance console log exists: /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start _get_guest_xml network_info=[{"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dee138d4-059b-489d-8122-cbb4b2c2112e', 'attached_at': '', 'detached_at': '', 'volume_id': '1189533d-fb93-4a26-9488-3427e27f4b53', 'serial': '1189533d-fb93-4a26-9488-3427e27f4b53'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '3892fd5c-212a-4dc7-af95-a5553445013d', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:02:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 06:02:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'vcpu_model' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:02:12 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:02:12 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:02:12 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc634b77-f295-43a1-829b-c4680227ba2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:02:12 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975d089-66d1-4d95-b115-c515dbdeb6b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53] added
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff56161-a837-4259-96c8-cd4ecb48a825]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dcd59-755f-4acb-bdf6-c137e9005b29]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXdTPGYF {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXdTPGYF" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674226f-e6ce-46e9-8efa-6cff73a1d2bc]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXdTPGYF'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6af9988-8d7a-40c6-b232-4e667dc9f28a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe0550-84c7-4d96-a01d-cf6ffe0c9ca4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a78dde9-31df-44bb-9ebe-5a4a30504a99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]
Nov 06 06:02:12 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5292a1-a550-47cf-85ae-779eec44c83a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e984f60d-c675-4966-8729-ae9a66dcae0c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:12 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae690323-1555-4fb4-9917-7c2ff2d3c700]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.501s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '26130373664666336', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130373664666336', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-ServerActionsTestOtherA-server-580424261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:02:13 user nova-compute[74903]:   <uuid>dee138d4-059b-489d-8122-cbb4b2c2112e</uuid>
Nov 06 06:02:13 user nova-compute[74903]:   <name>instance-0000000f</name>
Nov 06 06:02:13 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:02:13 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:02:13 user nova-compute[74903]:   <metadata>
Nov 06 06:02:13 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:02:13 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherA-server-580424261</nova:name>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:02:12</nova:creationTime>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:02:13 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:02:13 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:owner>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:user uuid="44c3df905516436e8a6c39e0f32a2e4b">tempest-ServerActionsTestOtherA-851074598-project-member</nova:user>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:project uuid="29b574412f0d4156a9d4538b17b2c163">tempest-ServerActionsTestOtherA-851074598</nova:project>
Nov 06 06:02:13 user nova-compute[74903]:       </nova:owner>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:02:13 user nova-compute[74903]:       <nova:ports>
Nov 06 06:02:13 user nova-compute[74903]:         <nova:port uuid="9033c9b3-0dba-4b46-bea3-5a3b0bf02649">
Nov 06 06:02:13 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 06:02:13 user nova-compute[74903]:         </nova:port>
Nov 06 06:02:13 user nova-compute[74903]:       </nova:ports>
Nov 06 06:02:13 user nova-compute[74903]:     </nova:instance>
Nov 06 06:02:13 user nova-compute[74903]:   </metadata>
Nov 06 06:02:13 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:02:13 user nova-compute[74903]:     <system>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="serial">dee138d4-059b-489d-8122-cbb4b2c2112e</entry>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="uuid">dee138d4-059b-489d-8122-cbb4b2c2112e</entry>
Nov 06 06:02:13 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:02:13 user nova-compute[74903]:     </system>
Nov 06 06:02:13 user nova-compute[74903]:   </sysinfo>
Nov 06 06:02:13 user nova-compute[74903]:   <os>
Nov 06 06:02:13 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:02:13 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:02:13 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:02:13 user nova-compute[74903]:   </os>
Nov 06 06:02:13 user nova-compute[74903]:   <features>
Nov 06 06:02:13 user nova-compute[74903]:     <acpi/>
Nov 06 06:02:13 user nova-compute[74903]:     <apic/>
Nov 06 06:02:13 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:02:13 user nova-compute[74903]:   </features>
Nov 06 06:02:13 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:02:13 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:02:13 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:02:13 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:02:13 user nova-compute[74903]:   </clock>
Nov 06 06:02:13 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:02:13 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:02:13 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:02:13 user nova-compute[74903]:   </cpu>
Nov 06 06:02:13 user nova-compute[74903]:   <devices>
Nov 06 06:02:13 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:02:13 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:02:13 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk"/>
Nov 06 06:02:13 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:02:13 user nova-compute[74903]:     </disk>
Nov 06 06:02:13 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:02:13 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:02:13 user nova-compute[74903]:       <source dev="/dev/sdc"/>
Nov 06 06:02:13 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:02:13 user nova-compute[74903]:       <serial>1189533d-fb93-4a26-9488-3427e27f4b53</serial>
Nov 06 06:02:13 user nova-compute[74903]:     </disk>
Nov 06 06:02:13 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:02:13 user nova-compute[74903]:       <mac address="fa:16:3e:2f:b5:21"/>
Nov 06 06:02:13 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:02:13 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:02:13 user nova-compute[74903]:       <target dev="tap9033c9b3-0d"/>
Nov 06 06:02:13 user nova-compute[74903]:     </interface>
Nov 06 06:02:13 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:02:13 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/console.log" append="off"/>
Nov 06 06:02:13 user nova-compute[74903]:     </serial>
Nov 06 06:02:13 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:02:13 user nova-compute[74903]:     <video>
Nov 06 06:02:13 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:02:13 user nova-compute[74903]:     </video>
Nov 06 06:02:13 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:02:13 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:02:13 user nova-compute[74903]:     </rng>
Nov 06 06:02:13 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:02:13 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:02:13 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:02:13 user nova-compute[74903]:     </memballoon>
Nov 06 06:02:13 user nova-compute[74903]:   </devices>
Nov 06 06:02:13 user nova-compute[74903]: </domain>
Nov 06 06:02:13 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-ServerActionsTestOtherA-server-580424261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG os_vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e0e2d71-accd-557f-aada-5ef4c4b708eb', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9033c9b3-0d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9033c9b3-0d, col_values=(('qos', UUID('51c18e46-f64f-461e-b1a5-3b788aed81b4')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9033c9b3-0d, col_values=(('external_ids', {'iface-id': '9033c9b3-0dba-4b46-bea3-5a3b0bf02649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:b5:21', 'vm-uuid': 'dee138d4-059b-489d-8122-cbb4b2c2112e'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:13 user nova-compute[74903]: INFO os_vif [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d')
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:2f:b5:21, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:15 user nova-compute[74903]: WARNING nova.compute.manager [req-db8d8c77-8826-49a5-92ea-60adb39701e1 req-7e15705c-8cab-414c-88c7-8e7a59b3ee47 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:02:17 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:02:17 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.400699615478516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance spawned successfully.
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:17 user nova-compute[74903]: WARNING nova.compute.manager [req-92835e2a-2280-4d70-bdc3-bcd990a7e223 req-9ebd63a3-eeff-4dae-9f0f-b6a6923d941b service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:02:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.117s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.865s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74903) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b486f09-fd2d-4f81-a033-917129d17b63 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.122s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:19 user nova-compute[74903]: INFO nova.compute.manager [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Detaching volume 96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:19 user nova-compute[74903]: INFO nova.virt.block_device [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Attempting to driver detach volume 96a676a5-a1bd-43f0-b76a-848f316c3262 from mountpoint /dev/vdb
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Attempting to detach device vdb from instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:02:19 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:02:19 user nova-compute[74903]:   <source dev="/dev/sdi"/>
Nov 06 06:02:19 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:02:19 user nova-compute[74903]:   <serial>96a676a5-a1bd-43f0-b76a-848f316c3262</serial>
Nov 06 06:02:19 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:02:19 user nova-compute[74903]: </disk>
Nov 06 06:02:19 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:02:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully detached device vdb from instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 from the persistent domain config.
Nov 06 06:02:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:02:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:02:19 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:02:19 user nova-compute[74903]:   <source dev="/dev/sdi"/>
Nov 06 06:02:19 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:02:19 user nova-compute[74903]:   <serial>96a676a5-a1bd-43f0-b76a-848f316c3262</serial>
Nov 06 06:02:19 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:02:19 user nova-compute[74903]: </disk>
Nov 06 06:02:19 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:02:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:02:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-changed-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Refreshing instance network info cache due to event network-changed-624be246-f0a3-4448-9c3b-8bfba73e4685. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] Acquiring lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] Acquired lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Refreshing network info cache for port 624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lazy-loading 'flavor' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:24 user nova-compute[74903]: INFO nova.compute.manager [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Attaching volume 6b060355-7015-4a5f-a3a4-4a870eab766e to /dev/vdb
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.utils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c8834f-328a-448f-a435-234454486dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f16b1ed-e4b9-48ae-b41c-6f5a14d847db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Updated VIF entry in instance network info cache for port 624be246-f0a3-4448-9c3b-8bfba73e4685. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating instance_info_cache with network_info: [{"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96f992-03ee-4479-8803-91018f29c737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d33d06-065e-4ffd-8f78-832e1836a5d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e9ba6e6b-fb65-44ce-8269-4e863b1bff4f req-67fa4c01-2fc4-48b3-a2c8-eeeb64c9e843 service nova] Releasing lock "refresh_cache-b781713b-1c98-4674-901c-a834bf648636" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:02:24 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:02:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae0a805-711c-46c9-a4aa-d174bb0cc4e0]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG os_brick.utils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:02:24 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating existing volume attachment record: 61b52e69-2e85-40e3-9785-0672b5dbf8f0 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:02:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 is timed out.
Nov 06 06:02:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully detached device vdb from instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 from the live domain config.
Nov 06 06:02:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMcqfxbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:02:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6af30d-e47e-4ebc-9be2-4b2bd78e5547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:02:40 user nova-compute[74903]: No targets found.
Nov 06 06:02:40 user nova-compute[74903]: iSNS:
Nov 06 06:02:40 user nova-compute[74903]: No targets found.
Nov 06 06:02:40 user nova-compute[74903]: STATIC:
Nov 06 06:02:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:02:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:02:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:02:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:02:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:02:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:02:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262
Nov 06 06:02:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:02:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:02:40 user nova-compute[74903]: FIRMWARE:
Nov 06 06:02:40 user nova-compute[74903]: No targets found.
Nov 06 06:02:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:02:40 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:02:40 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[885c6316-1105-4f6d-9ce8-a32dd22052dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0054af-b2dd-4d9f-bf50-f4c4f928e183]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:40 user nova-compute[74903]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:40 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 (non-flash)
Nov 06 06:02:40 user nova-compute[74903]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:40 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262'): ({'sdi'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Removing single pathed devices sdi {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[860844ec-7112-4da8-bf4d-0fb335a2d814]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87686915-740b-47b5-a130-d5a8ac4bfd5f]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flushing IO for device /dev/sdi {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7251ad6-e423-48a6-b179-239994eca114]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7211fd4-6834-4b60-aa0b-15df28928b90]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] SCSI volumes sdi have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f24b50-6bb5-4313-a856-fff6d62f950d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c9a4bc-78b0-4c7a-aa97-294814928700]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260]
Nov 06 06:02:40 user nova-compute[74903]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262, portal: 172.16.0.220,3260] successful.
Nov 06 06:02:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb676809-e6fb-45a7-a194-5554c357fe69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== disconnect_volume: return (362ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:02:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:41 user nova-compute[74903]: INFO nova.compute.manager [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Unrescuing
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG nova.objects.instance [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-457d4916-588d-4a95-a25e-d1887c9637aa tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.234s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.084s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:41 user nova-compute[74903]: INFO nova.compute.manager [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Terminating instance
Nov 06 06:02:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.objects.instance [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'flavor' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-unplugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] No waiting events found dispatching network-vif-unplugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-27344d44-4109-4b1d-af37-93e018f71744 req-ff359544-6b2b-401a-a152-8f90ab54291b service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-unplugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:02:42 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Instance destroyed successfully.
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.objects.instance [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'resources' on Instance uuid 9bbe873d-de34-4367-8ff5-d2e1b98b23a3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-309037987',display_name='tempest-VolumesSnapshotTestJSON-instance-309037987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-309037987',id=12,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhZmErjXa0fabvRV+DjEpbrO4TXmcQTG7If28g5kpMbI/aLeD0L5gbyFLBy248cHEbOqI7DHVA9Ed1f4DPKfJPMn41o9pZspDRBJW44DfkTcj67U4c/DvZZ0gfAv4wtZg==',key_name='tempest-keypair-632885547',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-x9wt8pa7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=9bbe873d-de34-4367-8ff5-d2e1b98b23a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "address": "fa:16:3e:51:8d:5d", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69689dd-cf", "ovs_interfaceid": "d69689dd-cfb2-40c5-b1fa-c3ef299f41bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_vif [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69689dd-cf, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:42 user nova-compute[74903]: WARNING nova.compute.manager [req-afab376b-e6ad-41ec-8b17-cbe6e907e6e1 req-08e859eb-ed66-410e-8e74-3bc60ae33198 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3519135e-9acd-42d3-9cf1-8aa475e2807c) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: INFO os_vif [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:8d:5d,bridge_name='br-int',has_traffic_filtering=True,id=d69689dd-cfb2-40c5-b1fa-c3ef299f41bf,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69689dd-cf')
Nov 06 06:02:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yMcqfxbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:02:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efb83bd-dc99-4e93-a553-603bd4167cc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:02:42 user nova-compute[74903]: No targets found.
Nov 06 06:02:42 user nova-compute[74903]: iSNS:
Nov 06 06:02:42 user nova-compute[74903]: No targets found.
Nov 06 06:02:42 user nova-compute[74903]: STATIC:
Nov 06 06:02:42 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:02:42 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:02:42 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:02:42 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:02:42 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:02:42 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:02:42 user nova-compute[74903]: FIRMWARE:
Nov 06 06:02:42 user nova-compute[74903]: No targets found.
Nov 06 06:02:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:02:42 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:02:42 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96a676a5-a1bd-43f0-b76a-848f316c3262', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:02:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b02babb-0903-4dcd-99f4-99af45b71659]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fdc6b0-39e8-4ca4-be61-7edb69023a3c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:43 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:02:43 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:02:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087bfa30>, {}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Disconnecting from: [] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.099s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== disconnect_volume: return (100ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:02:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Deleting instance files /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3_del
Nov 06 06:02:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Deletion of /opt/stack/data/nova/instances/9bbe873d-de34-4367-8ff5-d2e1b98b23a3_del complete
Nov 06 06:02:43 user nova-compute[74903]: INFO nova.compute.manager [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 06 06:02:43 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:02:43 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:02:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance destroyed successfully.
Nov 06 06:02:44 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:02:44 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Took 1.05 seconds to deallocate network for instance.
Nov 06 06:02:44 user nova-compute[74903]: WARNING nova.volume.cinder [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Attachment 477f9349-cceb-4849-9032-0f61dd2cf92a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 477f9349-cceb-4849-9032-0f61dd2cf92a. (HTTP 404) (Request-ID: req-4ab2a67b-a602-4e04-a321-98cc919ae199)
Nov 06 06:02:44 user nova-compute[74903]: INFO nova.compute.manager [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] Acquiring lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] No waiting events found dispatching network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:44 user nova-compute[74903]: WARNING nova.compute.manager [req-af8c9ddc-253a-4e75-b876-d5749d28c820 req-6173c5f8-f9ad-440b-a906-b7209a193191 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received unexpected event network-vif-plugged-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf for instance with vm_state deleted and task_state None.
Nov 06 06:02:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:02:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:44 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Deleted allocations for instance 9bbe873d-de34-4367-8ff5-d2e1b98b23a3
Nov 06 06:02:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:45 user nova-compute[74903]: WARNING nova.compute.manager [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:02:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-146a1f52-d5ac-4b31-b6a7-664e2dee4bbd req-68e2d67c-d64e-476c-b101-33a88cf6caa2 service nova] [instance: 9bbe873d-de34-4367-8ff5-d2e1b98b23a3] Received event network-vif-deleted-d69689dd-cfb2-40c5-b1fa-c3ef299f41bf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-10a9dc3e-2c3d-4c70-82e8-1e0aa65cb58c tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "9bbe873d-de34-4367-8ff5-d2e1b98b23a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.297s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-67821c1e-b580-4117-bbde-710a764db2be tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:47 user nova-compute[74903]: WARNING nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:02:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:02:47 user nova-compute[74903]: WARNING nova.compute.manager [req-db482585-f5c2-4179-aa7f-b46f4d356c0d req-12656ceb-2060-4ca8-935c-550c99341c8b service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:02:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:56 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:02:56 user nova-compute[74903]: INFO nova.compute.claims [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Claim successful on node user
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:02:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.policy [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16796bd87812434689edbdde4d086818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371e43fd9d594cd6afca5da129747603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:02:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Creating image(s)
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.261s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Successfully created port: e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk 1073741824" returned: 0 in 0.060s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Cannot resize image /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Ensure instance console log exists: /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:02:58 user nova-compute[74903]: INFO nova.compute.claims [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Claim successful on node user
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Successfully updated port: e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing instance network info cache due to event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:02:58 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:02:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.policy [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5380e1aa9f6c43dda84e1528cb964a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd56e3653ea34efcab24bd58a8b2d6d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:02:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Creating image(s)
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance network_info: |[{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.neutron [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start _get_guest_xml network_info=[{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:02:59 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:02:59 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRiYW4ukChs+JZOBpsK9ynUaGRNjeWYCJO6a2zz4ZoAtjjYxe/YVN1ryCoIZ5nJJ953kmtJ2Lc82AxpuoEvEcoHLeOOEJXP9F7+HG6Cm/2afiYjncfeAGjopBOBB+JcGA==',key_name='tempest-keypair-610860067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:02:59 user nova-compute[74903]:   <uuid>6a685cae-989a-473d-80b9-ded3974de38c</uuid>
Nov 06 06:02:59 user nova-compute[74903]:   <name>instance-00000013</name>
Nov 06 06:02:59 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:02:59 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:02:59 user nova-compute[74903]:   <metadata>
Nov 06 06:02:59 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:02:59 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1784805946</nova:name>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:02:59</nova:creationTime>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:02:59 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:02:59 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:owner>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:user uuid="16796bd87812434689edbdde4d086818">tempest-AttachVolumeShelveTestJSON-1668474455-project-member</nova:user>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:project uuid="371e43fd9d594cd6afca5da129747603">tempest-AttachVolumeShelveTestJSON-1668474455</nova:project>
Nov 06 06:02:59 user nova-compute[74903]:       </nova:owner>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:02:59 user nova-compute[74903]:       <nova:ports>
Nov 06 06:02:59 user nova-compute[74903]:         <nova:port uuid="e1d84ce5-1ca7-4cbc-a19a-379a9dec744a">
Nov 06 06:02:59 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:02:59 user nova-compute[74903]:         </nova:port>
Nov 06 06:02:59 user nova-compute[74903]:       </nova:ports>
Nov 06 06:02:59 user nova-compute[74903]:     </nova:instance>
Nov 06 06:02:59 user nova-compute[74903]:   </metadata>
Nov 06 06:02:59 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:02:59 user nova-compute[74903]:     <system>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="serial">6a685cae-989a-473d-80b9-ded3974de38c</entry>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="uuid">6a685cae-989a-473d-80b9-ded3974de38c</entry>
Nov 06 06:02:59 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:02:59 user nova-compute[74903]:     </system>
Nov 06 06:02:59 user nova-compute[74903]:   </sysinfo>
Nov 06 06:02:59 user nova-compute[74903]:   <os>
Nov 06 06:02:59 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:02:59 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:02:59 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:02:59 user nova-compute[74903]:   </os>
Nov 06 06:02:59 user nova-compute[74903]:   <features>
Nov 06 06:02:59 user nova-compute[74903]:     <acpi/>
Nov 06 06:02:59 user nova-compute[74903]:     <apic/>
Nov 06 06:02:59 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:02:59 user nova-compute[74903]:   </features>
Nov 06 06:02:59 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:02:59 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:02:59 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:02:59 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:02:59 user nova-compute[74903]:   </clock>
Nov 06 06:02:59 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:02:59 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:02:59 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:02:59 user nova-compute[74903]:   </cpu>
Nov 06 06:02:59 user nova-compute[74903]:   <devices>
Nov 06 06:02:59 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:02:59 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:02:59 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk"/>
Nov 06 06:02:59 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:02:59 user nova-compute[74903]:     </disk>
Nov 06 06:02:59 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:02:59 user nova-compute[74903]:       <mac address="fa:16:3e:b7:be:02"/>
Nov 06 06:02:59 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:02:59 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:02:59 user nova-compute[74903]:       <target dev="tape1d84ce5-1c"/>
Nov 06 06:02:59 user nova-compute[74903]:     </interface>
Nov 06 06:02:59 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:02:59 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/console.log" append="off"/>
Nov 06 06:02:59 user nova-compute[74903]:     </serial>
Nov 06 06:02:59 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:02:59 user nova-compute[74903]:     <video>
Nov 06 06:02:59 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:02:59 user nova-compute[74903]:     </video>
Nov 06 06:02:59 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:02:59 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:02:59 user nova-compute[74903]:     </rng>
Nov 06 06:02:59 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:02:59 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:02:59 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:02:59 user nova-compute[74903]:     </memballoon>
Nov 06 06:02:59 user nova-compute[74903]:   </devices>
Nov 06 06:02:59 user nova-compute[74903]: </domain>
Nov 06 06:02:59 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRiYW4ukChs+JZOBpsK9ynUaGRNjeWYCJO6a2zz4ZoAtjjYxe/YVN1ryCoIZ5nJJ953kmtJ2Lc82AxpuoEvEcoHLeOOEJXP9F7+HG6Cm/2afiYjncfeAGjopBOBB+JcGA==',key_name='tempest-keypair-610860067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG os_vif [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362f32ff-e4be-5714-9289-20a4c3ee624d', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d84ce5-1c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1d84ce5-1c, col_values=(('qos', UUID('5d18fe74-7b32-420e-984c-85a9c31d5547')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1d84ce5-1c, col_values=(('external_ids', {'iface-id': 'e1d84ce5-1ca7-4cbc-a19a-379a9dec744a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:be:02', 'vm-uuid': '6a685cae-989a-473d-80b9-ded3974de38c'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:02:59 user nova-compute[74903]: INFO os_vif [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c')
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk 1073741824" returned: 0 in 0.050s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No VIF found with MAC fa:16:3e:b7:be:02, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Cannot resize image /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Ensure instance console log exists: /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:02:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Successfully created port: bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updated VIF entry in instance network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e380aa90-d838-4e23-a525-d7a160d71554 req-a5d849e8-9077-4d8a-8eb8-4300b8bf153e service nova] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Successfully updated port: bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-changed-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Refreshing instance network info cache due to event network-changed-bd470b96-807a-4d77-8af1-362676fa3552. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance network_info: |[{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.neutron [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Refreshing network info cache for port bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start _get_guest_xml network_info=[{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:03:01 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:01 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:01 user nova-compute[74903]: WARNING nova.compute.manager [req-959fc253-e4cc-44b7-8191-0a23054973a0 req-6ff03099-1769-41e8-a744-e6efd358a9fb service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state building and task_state spawning.
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:03:01 user nova-compute[74903]:   <uuid>3cff20f3-7370-43ad-a050-1cbd107aaf52</uuid>
Nov 06 06:03:01 user nova-compute[74903]:   <name>instance-00000014</name>
Nov 06 06:03:01 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:03:01 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:03:01 user nova-compute[74903]:   <metadata>
Nov 06 06:03:01 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:03:01 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherB-server-1513746207</nova:name>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:03:01</nova:creationTime>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:03:01 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:03:01 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:owner>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:user uuid="5380e1aa9f6c43dda84e1528cb964a55">tempest-ServerActionsTestOtherB-325946081-project-member</nova:user>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:project uuid="fd56e3653ea34efcab24bd58a8b2d6d8">tempest-ServerActionsTestOtherB-325946081</nova:project>
Nov 06 06:03:01 user nova-compute[74903]:       </nova:owner>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:03:01 user nova-compute[74903]:       <nova:ports>
Nov 06 06:03:01 user nova-compute[74903]:         <nova:port uuid="bd470b96-807a-4d77-8af1-362676fa3552">
Nov 06 06:03:01 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:03:01 user nova-compute[74903]:         </nova:port>
Nov 06 06:03:01 user nova-compute[74903]:       </nova:ports>
Nov 06 06:03:01 user nova-compute[74903]:     </nova:instance>
Nov 06 06:03:01 user nova-compute[74903]:   </metadata>
Nov 06 06:03:01 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:03:01 user nova-compute[74903]:     <system>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="serial">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="uuid">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:03:01 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:03:01 user nova-compute[74903]:     </system>
Nov 06 06:03:01 user nova-compute[74903]:   </sysinfo>
Nov 06 06:03:01 user nova-compute[74903]:   <os>
Nov 06 06:03:01 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:03:01 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:03:01 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:03:01 user nova-compute[74903]:   </os>
Nov 06 06:03:01 user nova-compute[74903]:   <features>
Nov 06 06:03:01 user nova-compute[74903]:     <acpi/>
Nov 06 06:03:01 user nova-compute[74903]:     <apic/>
Nov 06 06:03:01 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:03:01 user nova-compute[74903]:   </features>
Nov 06 06:03:01 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:03:01 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:03:01 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:03:01 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:03:01 user nova-compute[74903]:   </clock>
Nov 06 06:03:01 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:03:01 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:03:01 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:03:01 user nova-compute[74903]:   </cpu>
Nov 06 06:03:01 user nova-compute[74903]:   <devices>
Nov 06 06:03:01 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:03:01 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:03:01 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk"/>
Nov 06 06:03:01 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:03:01 user nova-compute[74903]:     </disk>
Nov 06 06:03:01 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:03:01 user nova-compute[74903]:       <mac address="fa:16:3e:dd:89:27"/>
Nov 06 06:03:01 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:01 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:03:01 user nova-compute[74903]:       <target dev="tapbd470b96-80"/>
Nov 06 06:03:01 user nova-compute[74903]:     </interface>
Nov 06 06:03:01 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:03:01 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/console.log" append="off"/>
Nov 06 06:03:01 user nova-compute[74903]:     </serial>
Nov 06 06:03:01 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:03:01 user nova-compute[74903]:     <video>
Nov 06 06:03:01 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:01 user nova-compute[74903]:     </video>
Nov 06 06:03:01 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:03:01 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:03:01 user nova-compute[74903]:     </rng>
Nov 06 06:03:01 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:03:01 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:03:01 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:03:01 user nova-compute[74903]:     </memballoon>
Nov 06 06:03:01 user nova-compute[74903]:   </devices>
Nov 06 06:03:01 user nova-compute[74903]: </domain>
Nov 06 06:03:01 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG os_vif [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff1159ac-1c50-5d24-88b3-e9d2b4c3b4ff', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd470b96-80, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd470b96-80, col_values=(('qos', UUID('8d707fb4-ebb8-493f-9cd3-851e82330db2')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd470b96-80, col_values=(('external_ids', {'iface-id': 'bd470b96-807a-4d77-8af1-362676fa3552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:89:27', 'vm-uuid': '3cff20f3-7370-43ad-a050-1cbd107aaf52'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: INFO os_vif [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No VIF found with MAC fa:16:3e:dd:89:27, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.neutron [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updated VIF entry in instance network info cache for port bd470b96-807a-4d77-8af1-362676fa3552. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG nova.network.neutron [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e98f56f5-65ab-4979-8488-b1fde9784066 req-d16bdaab-1124-4c66-be70-70c4c9b99835 service nova] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:03 user nova-compute[74903]: WARNING nova.compute.manager [req-40de3fc5-89e4-405b-bd19-b3fb494f40db req-14d96b97-1233-44b7-bf0e-697da6be1a19 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state building and task_state spawning.
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:03:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance spawned successfully.
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:03 user nova-compute[74903]: WARNING nova.compute.manager [req-c3cb6f0c-583d-4687-91ea-9f151101cff9 req-ee267578-c50d-4079-9b9d-99897d005342 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state building and task_state spawning.
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:03 user nova-compute[74903]: INFO nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 06 06:03:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:03 user nova-compute[74903]: INFO nova.compute.manager [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Took 7.07 seconds to build instance.
Nov 06 06:03:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5183738d-0a97-4001-be27-ea2b9fafe977 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.184s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:05 user nova-compute[74903]: WARNING nova.compute.manager [req-86e7f497-d044-4830-abee-731a21dcf1d4 req-d32434eb-6300-4da9-b3ce-81a8aff22e8d service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state building and task_state spawning.
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:03:05 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance spawned successfully.
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:05 user nova-compute[74903]: INFO nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 06 06:03:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:03:05 user nova-compute[74903]: INFO nova.compute.manager [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Took 7.36 seconds to build instance.
Nov 06 06:03:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aa57630-9ff7-4fbd-aa92-c8897bcd04f4 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.468s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:03:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:03:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [{"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-62b2e140-f082-47b9-8347-25ad5123e39e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:03:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-changed-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Refreshing instance network info cache due to event network-changed-a140e256-f8be-4d67-b38e-5832d2a6e650. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] Acquiring lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] Acquired lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG nova.network.neutron [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Refreshing network info cache for port a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG nova.network.neutron [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updated VIF entry in instance network info cache for port a140e256-f8be-4d67-b38e-5832d2a6e650. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG nova.network.neutron [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating instance_info_cache with network_info: [{"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-107bfa4d-4b85-4c2f-bf16-8b0e4f101544 req-204c72ff-99c9-4700-a8b3-bb7ad9c45f4f service nova] Releasing lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:03:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:17 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:17 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.369327545166016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:03:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 6a685cae-989a-473d-80b9-ded3974de38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:03:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.852s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG nova.objects.instance [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'flavor' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:20 user nova-compute[74903]: INFO nova.compute.manager [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Attaching volume 9d372750-1b30-4c60-9328-ab8524db25f3 to /dev/vdb
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.utils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[49178076-3a1a-427d-b60a-8d815dac8855]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4af367-2b5c-4865-a5a5-b92a421e5597]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b990d3fe-1f5d-4259-a792-3f1f90e5ef54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1325c4c1-092c-40af-85c0-4f0f8f48aaa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:20 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:03:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cddf62-3902-4924-93c5-b0f89d04b4bc]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG os_brick.utils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating existing volume attachment record: a5cb57b3-3aea-4249-ab2d-280cca0ea9ff {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:03:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-changed-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing instance network info cache due to event network-changed-be91300f-ea64-409f-a8c0-597d0d8fdf58. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing network info cache for port be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:21 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:21 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:21 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8dd916-73c4-445f-bc76-b048ec198534]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:03:21 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87220756-54b5-449e-a5f7-94c3015f7823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e] added
Nov 06 06:03:21 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d19a76-0477-49af-8685-38563895f4c9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d561a42-8328-4af0-afe3-04aea25cb024]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIBzePWp {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIBzePWp" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7d7dc-a36a-40fc-82c6-0a55365969cd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIBzePWp'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ee2489-caaf-4463-bd43-366308970f00]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa1db8a-909b-45ff-a1eb-3b53bad1ba3e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:22 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:22 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7134637-5314-4afd-999f-739c22d0f040]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]
Nov 06 06:03:22 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.
Nov 06 06:03:22 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32078b0-2140-417f-8f00-adbb87ec77d5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[67205d54-e4f2-4074-b790-df8c88eb106c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:22 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:22 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:22 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c255e3-58fb-4c5f-ab79-2366e62d35be]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updated VIF entry in instance network info cache for port be91300f-ea64-409f-a8c0-597d0d8fdf58. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03b3c821-df45-4fb8-a187-a20742552ee5 req-df97e07c-c088-4d7a-ab45-8ae1d1b460c9 service nova] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'pci_requests' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.objects.base [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Object Instance<5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db> lazy-loaded attributes: flavor,pci_requests {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:03:22 user nova-compute[74903]: DEBUG nova.policy [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5df2a7857d124d31b806d45b3129a884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d9a876d7e4959b411546efc318ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Successfully created port: 75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23666616533316363', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666616533316363', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.objects.instance [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lazy-loading 'flavor' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:03:23 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:03:23 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:03:23 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:03:23 user nova-compute[74903]:   <serial>6b060355-7015-4a5f-a3a4-4a870eab766e</serial>
Nov 06 06:03:23 user nova-compute[74903]: </disk>
Nov 06 06:03:23 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] No VIF found with MAC fa:16:3e:c6:ab:93, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-888d3982-28d6-4a40-a406-55e1c2abcd77 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 59.195s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Successfully updated port: 75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-changed-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing instance network info cache due to event network-changed-75369dce-72cd-4324-8a18-7d77e444964b. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Refreshing network info cache for port 75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG os_vif [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bf5c6fc-f207-5c21-95e6-8062f0065125', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75369dce-72, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75369dce-72, col_values=(('qos', UUID('515b3ef5-934a-4d47-afd5-7f2129b254a7')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75369dce-72, col_values=(('external_ids', {'iface-id': '75369dce-72cd-4324-8a18-7d77e444964b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:2a:a1', 'vm-uuid': '5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: INFO os_vif [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72')
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] attach device xml: <interface type="ethernet">
Nov 06 06:03:24 user nova-compute[74903]:   <mac address="fa:16:3e:3f:2a:a1"/>
Nov 06 06:03:24 user nova-compute[74903]:   <model type="virtio"/>
Nov 06 06:03:24 user nova-compute[74903]:   <mtu size="1442"/>
Nov 06 06:03:24 user nova-compute[74903]:   <target dev="tap75369dce-72"/>
Nov 06 06:03:24 user nova-compute[74903]: </interface>
Nov 06 06:03:24 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:25 user nova-compute[74903]: WARNING nova.compute.manager [req-53bcf588-3806-4900-92e8-3ef778aa5e24 req-cf93951f-30b6-45c1-bc23-26456c3fb544 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b for instance with vm_state active and task_state None.
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name hda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No VIF found with MAC fa:16:3e:1b:a5:de, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.utils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updated VIF entry in instance network info cache for port 75369dce-72cd-4324-8a18-7d77e444964b. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe3ddd-28f4-4eee-a261-a7b495f32b16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:03:25 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:03:25</nova:creationTime>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:03:25 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:03:25 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:owner>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:03:25 user nova-compute[74903]:   </nova:owner>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:03:25 user nova-compute[74903]:   <nova:ports>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:03:25 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:03:25 user nova-compute[74903]:     </nova:port>
Nov 06 06:03:25 user nova-compute[74903]:     <nova:port uuid="75369dce-72cd-4324-8a18-7d77e444964b">
Nov 06 06:03:25 user nova-compute[74903]:       <nova:ip type="fixed" address="10.10.10.5" ipVersion="4"/>
Nov 06 06:03:25 user nova-compute[74903]:     </nova:port>
Nov 06 06:03:25 user nova-compute[74903]:   </nova:ports>
Nov 06 06:03:25 user nova-compute[74903]: </nova:instance>
Nov 06 06:03:25 user nova-compute[74903]:  {{(pid=74903) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5623c275-3981-407f-9245-29139af89cee req-24b9dc2c-5302-4b0f-8820-e1ff89f139c7 service nova] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a4efea-deed-450e-ac9a-334d6ceb4966]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c1a6dd-304a-4713-9e98-883922e7dba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7d9c1-f8de-4344-b336-f849f5fb02e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4182954b-b65e-45d5-b2c0-ade2aca0b2bf tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.535s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:25 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:03:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a4ddb2-4d7f-46e4-b3af-b59c0031b2d5]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:03:25 user nova-compute[74903]: DEBUG os_brick.utils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:25 user nova-compute[74903]: INFO nova.compute.manager [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Swapping volume 6b060355-7015-4a5f-a3a4-4a870eab766e for 6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:03:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:26 user nova-compute[74903]: INFO nova.compute.manager [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Attaching volume 75c579f1-66a4-4718-bee8-b5220b336215 to /dev/vdb
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f87a1-0ee2-43b0-8420-924d92c19d7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb65fbc-afbd-4a50-9bd6-0a1e351c8f29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[daccf6e0-5ed4-467e-b822-092d930fa49a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a965b8-c8b6-41a3-8c81-1861ad4e7441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:26 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:03:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e1ccef-6001-4eb5-aecf-89bee383ccaa]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:26 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating existing volume attachment record: 2cb6593f-dfea-4a31-a827-1c1f03293be2 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:03:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:27 user nova-compute[74903]: WARNING nova.compute.manager [req-a920c08e-2b88-4683-8f85-080910a0455d req-53e63b09-9bae-4d26-a53b-018572e45e43 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b for instance with vm_state active and task_state None.
Nov 06 06:03:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrISxCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:44 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:44 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:44 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef8b023-851b-44da-b62a-533063a315ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:03:44 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b59c8c-0bfd-4a54-baf9-c17ce0c91af1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3] added
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[49251abd-6dbc-4674-a65e-a76a5afba4b5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e03a3ff-7caf-4e35-8a84-0b2aff1c957b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJrISxCK {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJrISxCK" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[db912275-8d87-46d9-b0d0-f0be80aa9d01]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJrISxCK'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51b3ce-11e4-4344-be93-f9312412dabd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[50125496-f113-4d2b-b550-c20f27058fc7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6320bf9-95c2-4461-b911-95b4bb9853e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260]
Nov 06 06:03:44 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260] successful.
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[821e620c-882e-4b68-b049-bb27edd319fa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[197422c8-4df3-44dc-8767-c1bf74c52be3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:44 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee5586-0065-42a1-8229-9e221657426b]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrISxCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23563396238313763', 'path': '/dev/sde'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563396238313763', 'path': '/dev/sde'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'flavor' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:03:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:03:45 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:03:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:03:45 user nova-compute[74903]:   <serial>9d372750-1b30-4c60-9328-ab8524db25f3</serial>
Nov 06 06:03:45 user nova-compute[74903]: </disk>
Nov 06 06:03:45 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:03:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] No VIF found with MAC fa:16:3e:8a:34:7f, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-db5c3f33-77c1-45ab-8ddd-60baabc8122d tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.922s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:03:47 user nova-compute[74903]: INFO nova.compute.claims [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Claim successful on node user
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:03:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:03:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:03:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG nova.policy [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f23b6ac95ae4183a9f74b1927407f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac1d35737f4599bfc799afb620174c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:03:48 user nova-compute[74903]: INFO nova.virt.block_device [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Booting with volume 1b89cecf-83ad-413d-ad2c-db8205ab62a9 at /dev/vda
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9958063f-8a91-4784-8c5d-fa22d7ddac9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c5b16b-f668-46f2-9ce1-4bc30ce91dc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6112bfb8-01f3-4a91-9ef1-6f08d2bcc159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008d3f8-2a65-4d46-af9b-b62c2bdbaccf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:03:48 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:03:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c53d8e-9780-4d29-81f5-a72d31a00240]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating existing volume attachment record: 71072b4b-10e8-4d6c-82d0-793dccd89169 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:48 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Successfully created port: b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Successfully updated port: b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing instance network info cache due to event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance network_info: |[{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG nova.network.neutron [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updated VIF entry in instance network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG nova.network.neutron [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-069a25ba-df10-4b1e-8019-806c0aeec500 req-fe6f6dd9-47b6-4efd-82f9-dd673c889347 service nova] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUBonrtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:03:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:03:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:03:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:03:50 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:03:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786f7ba-d3e0-46b6-a40f-8e4d0ddb0ffd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:03:51 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b45a9b-17d4-4ed1-94ae-09e73e1dfbd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215] added
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0214b3-2347-40f9-abbe-f342a1b5be0a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2558c024-750d-429b-a9c8-1a4ef60956ba]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUBonrtq {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUBonrtq" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dcbee6-39ef-48cd-85c9-77acf5e581ff]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUBonrtq'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef166364-9372-4785-8da8-2990bef5da80]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b28a99-441c-4bab-a72c-10bf0531314d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f2fb8-59cf-4c7c-933a-25f36b6df191]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260]
Nov 06 06:03:51 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260] successful.
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a88e5-2bbb-4570-952a-59210daf79a1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bd655-8048-4343-b003-4eca52ef983e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:03:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:03:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d147301-92a7-4c07-8c18-ab2fbb899462]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:03:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUBonrtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26561306338626636', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306338626636', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:03:52 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:03:52 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:03:52 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:03:52 user nova-compute[74903]:   <serial>75c579f1-66a4-4718-bee8-b5220b336215</serial>
Nov 06 06:03:52 user nova-compute[74903]: </disk>
Nov 06 06:03:52 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:03:52 user nova-compute[74903]: INFO nova.compute.claims [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Claim successful on node user
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No BDM found with device name hda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] No VIF found with MAC fa:16:3e:1b:a5:de, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:03:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d594739b-0a1e-4287-b06f-80a107e0d353 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.693s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:03:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.policy [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd524e206cbd74470ac85aaad34748925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0407911ca4ad4d06a00c04da2a5b121c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:03:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Creating image(s)
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "/opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "/opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "/opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.246s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk 1073741824" returned: 0 in 0.059s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:53 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Successfully created port: 106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Cannot resize image /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Ensure instance console log exists: /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:03:54 user nova-compute[74903]: INFO nova.compute.claims [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Claim successful on node user
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:54 user nova-compute[74903]: INFO nova.compute.manager [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Detaching volume 75c579f1-66a4-4718-bee8-b5220b336215
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Successfully updated port: 106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquired lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:03:54 user nova-compute[74903]: INFO nova.virt.block_device [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Attempting to driver detach volume 75c579f1-66a4-4718-bee8-b5220b336215 from mountpoint /dev/vdb
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-changed-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Refreshing instance network info cache due to event network-changed-106503e0-5cc4-46f7-bcd2-d66a078793cf. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] Acquiring lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Attempting to detach device vdb from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:03:54 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:03:54 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:03:54 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:03:54 user nova-compute[74903]:   <serial>75c579f1-66a4-4718-bee8-b5220b336215</serial>
Nov 06 06:03:54 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:03:54 user nova-compute[74903]: </disk>
Nov 06 06:03:54 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:03:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully detached device vdb from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the persistent domain config.
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:03:54 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:03:54 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:03:54 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:03:54 user nova-compute[74903]:   <serial>75c579f1-66a4-4718-bee8-b5220b336215</serial>
Nov 06 06:03:54 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:03:54 user nova-compute[74903]: </disk>
Nov 06 06:03:54 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:03:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:03:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.neutron [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Updating instance_info_cache with network_info: [{"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Releasing lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Instance network_info: |[{"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] Acquired lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Refreshing network info cache for port 106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Start _get_guest_xml network_info=[{"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.policy [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a651fca6654461c81036f79a46892ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8cbdaee9b7f4323a120240fef7ea443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:03:55 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:55 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410095098',display_name='tempest-VolumesActionsTest-instance-1410095098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1410095098',id=22,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-8cgm3t7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:53Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=510bcb77-b1fc-4009-a17e-8673dc9b77df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.objects.instance [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lazy-loading 'pci_devices' on Instance uuid 510bcb77-b1fc-4009-a17e-8673dc9b77df {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:03:55 user nova-compute[74903]:   <uuid>510bcb77-b1fc-4009-a17e-8673dc9b77df</uuid>
Nov 06 06:03:55 user nova-compute[74903]:   <name>instance-00000016</name>
Nov 06 06:03:55 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:03:55 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:03:55 user nova-compute[74903]:   <metadata>
Nov 06 06:03:55 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:03:55 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:name>tempest-VolumesActionsTest-instance-1410095098</nova:name>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:03:55</nova:creationTime>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:03:55 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:03:55 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:owner>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:user uuid="d524e206cbd74470ac85aaad34748925">tempest-VolumesActionsTest-1503865399-project-member</nova:user>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:project uuid="0407911ca4ad4d06a00c04da2a5b121c">tempest-VolumesActionsTest-1503865399</nova:project>
Nov 06 06:03:55 user nova-compute[74903]:       </nova:owner>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:03:55 user nova-compute[74903]:       <nova:ports>
Nov 06 06:03:55 user nova-compute[74903]:         <nova:port uuid="106503e0-5cc4-46f7-bcd2-d66a078793cf">
Nov 06 06:03:55 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:03:55 user nova-compute[74903]:         </nova:port>
Nov 06 06:03:55 user nova-compute[74903]:       </nova:ports>
Nov 06 06:03:55 user nova-compute[74903]:     </nova:instance>
Nov 06 06:03:55 user nova-compute[74903]:   </metadata>
Nov 06 06:03:55 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:03:55 user nova-compute[74903]:     <system>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="serial">510bcb77-b1fc-4009-a17e-8673dc9b77df</entry>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="uuid">510bcb77-b1fc-4009-a17e-8673dc9b77df</entry>
Nov 06 06:03:55 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:03:55 user nova-compute[74903]:     </system>
Nov 06 06:03:55 user nova-compute[74903]:   </sysinfo>
Nov 06 06:03:55 user nova-compute[74903]:   <os>
Nov 06 06:03:55 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:03:55 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:03:55 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:03:55 user nova-compute[74903]:   </os>
Nov 06 06:03:55 user nova-compute[74903]:   <features>
Nov 06 06:03:55 user nova-compute[74903]:     <acpi/>
Nov 06 06:03:55 user nova-compute[74903]:     <apic/>
Nov 06 06:03:55 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:03:55 user nova-compute[74903]:   </features>
Nov 06 06:03:55 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:03:55 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:03:55 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:03:55 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:03:55 user nova-compute[74903]:   </clock>
Nov 06 06:03:55 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:03:55 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:03:55 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:03:55 user nova-compute[74903]:   </cpu>
Nov 06 06:03:55 user nova-compute[74903]:   <devices>
Nov 06 06:03:55 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:03:55 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:03:55 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk"/>
Nov 06 06:03:55 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:03:55 user nova-compute[74903]:     </disk>
Nov 06 06:03:55 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:03:55 user nova-compute[74903]:       <mac address="fa:16:3e:1b:70:e4"/>
Nov 06 06:03:55 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:55 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:03:55 user nova-compute[74903]:       <target dev="tap106503e0-5c"/>
Nov 06 06:03:55 user nova-compute[74903]:     </interface>
Nov 06 06:03:55 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:03:55 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/console.log" append="off"/>
Nov 06 06:03:55 user nova-compute[74903]:     </serial>
Nov 06 06:03:55 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:03:55 user nova-compute[74903]:     <video>
Nov 06 06:03:55 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:55 user nova-compute[74903]:     </video>
Nov 06 06:03:55 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:03:55 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:03:55 user nova-compute[74903]:     </rng>
Nov 06 06:03:55 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:03:55 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:03:55 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:03:55 user nova-compute[74903]:     </memballoon>
Nov 06 06:03:55 user nova-compute[74903]:   </devices>
Nov 06 06:03:55 user nova-compute[74903]: </domain>
Nov 06 06:03:55 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410095098',display_name='tempest-VolumesActionsTest-instance-1410095098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1410095098',id=22,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-8cgm3t7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:53Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=510bcb77-b1fc-4009-a17e-8673dc9b77df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG os_vif [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b162e13-3065-5902-8096-70a2ef4aa2cd', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap106503e0-5c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap106503e0-5c, col_values=(('qos', UUID('5bc2e86f-3b09-4ff6-85c5-28625db3fc00')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap106503e0-5c, col_values=(('external_ids', {'iface-id': '106503e0-5cc4-46f7-bcd2-d66a078793cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:70:e4', 'vm-uuid': '510bcb77-b1fc-4009-a17e-8673dc9b77df'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:03:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Creating image(s)
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:55 user nova-compute[74903]: INFO os_vif [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c')
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] No VIF found with MAC fa:16:3e:1b:70:e4, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk 1073741824" returned: 0 in 0.064s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Checking if we can resize image /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:03:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Cannot resize image /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Ensure instance console log exists: /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Updated VIF entry in instance network info cache for port 106503e0-5cc4-46f7-bcd2-d66a078793cf. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Updating instance_info_cache with network_info: [{"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf24cd6-b72b-4743-be1b-a5b35fc4d6df req-cbdfd9d1-c45b-42c7-ae54-53b9018ef35a service nova] Releasing lock "refresh_cache-510bcb77-b1fc-4009-a17e-8673dc9b77df" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Successfully created port: 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Successfully updated port: 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing instance network info cache due to event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] No waiting events found dispatching network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:56 user nova-compute[74903]: WARNING nova.compute.manager [req-167659ee-3123-4dac-b831-ee0d5de0ebc6 req-1ebaed16-ae4a-485c-adfd-5646e3e79b0e service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received unexpected event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf for instance with vm_state building and task_state spawning.
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance network_info: |[{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start _get_guest_xml network_info=[{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:03:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1447677904',display_name='tempest-ServerRescueNegativeTestJSON-server-1447677904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1447677904',id=23,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgW7PD81gI6GHkukGSC3wfWAkjxfJo5pr60EENpM4Z2HWRRQosxm5AXbGhgCV2qNZWJWB6YrehuBw7yS4U+q6mCAMU8o1nME88e5r9FVjP00P90vhBUkLBsd9SnMtA+4w==',key_name='tempest-keypair-970855336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-wvxbg2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a651fca6654461c81036f79a46892ef',uuid=457a1716-198e-4054-b665-9e9af54f8c09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:03:57 user nova-compute[74903]:   <uuid>457a1716-198e-4054-b665-9e9af54f8c09</uuid>
Nov 06 06:03:57 user nova-compute[74903]:   <name>instance-00000017</name>
Nov 06 06:03:57 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:03:57 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:03:57 user nova-compute[74903]:   <metadata>
Nov 06 06:03:57 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:03:57 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1447677904</nova:name>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:03:57</nova:creationTime>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:03:57 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:03:57 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:owner>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 06:03:57 user nova-compute[74903]:       </nova:owner>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:03:57 user nova-compute[74903]:       <nova:ports>
Nov 06 06:03:57 user nova-compute[74903]:         <nova:port uuid="63e0d648-6523-4aa2-8200-7f3e73a45080">
Nov 06 06:03:57 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:03:57 user nova-compute[74903]:         </nova:port>
Nov 06 06:03:57 user nova-compute[74903]:       </nova:ports>
Nov 06 06:03:57 user nova-compute[74903]:     </nova:instance>
Nov 06 06:03:57 user nova-compute[74903]:   </metadata>
Nov 06 06:03:57 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:03:57 user nova-compute[74903]:     <system>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="serial">457a1716-198e-4054-b665-9e9af54f8c09</entry>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="uuid">457a1716-198e-4054-b665-9e9af54f8c09</entry>
Nov 06 06:03:57 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:03:57 user nova-compute[74903]:     </system>
Nov 06 06:03:57 user nova-compute[74903]:   </sysinfo>
Nov 06 06:03:57 user nova-compute[74903]:   <os>
Nov 06 06:03:57 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:03:57 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:03:57 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:03:57 user nova-compute[74903]:   </os>
Nov 06 06:03:57 user nova-compute[74903]:   <features>
Nov 06 06:03:57 user nova-compute[74903]:     <acpi/>
Nov 06 06:03:57 user nova-compute[74903]:     <apic/>
Nov 06 06:03:57 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:03:57 user nova-compute[74903]:   </features>
Nov 06 06:03:57 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:03:57 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:03:57 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:03:57 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:03:57 user nova-compute[74903]:   </clock>
Nov 06 06:03:57 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:03:57 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:03:57 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:03:57 user nova-compute[74903]:   </cpu>
Nov 06 06:03:57 user nova-compute[74903]:   <devices>
Nov 06 06:03:57 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:03:57 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:03:57 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk"/>
Nov 06 06:03:57 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:03:57 user nova-compute[74903]:     </disk>
Nov 06 06:03:57 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:03:57 user nova-compute[74903]:       <mac address="fa:16:3e:a4:d1:48"/>
Nov 06 06:03:57 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:57 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:03:57 user nova-compute[74903]:       <target dev="tap63e0d648-65"/>
Nov 06 06:03:57 user nova-compute[74903]:     </interface>
Nov 06 06:03:57 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:03:57 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/console.log" append="off"/>
Nov 06 06:03:57 user nova-compute[74903]:     </serial>
Nov 06 06:03:57 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:03:57 user nova-compute[74903]:     <video>
Nov 06 06:03:57 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:03:57 user nova-compute[74903]:     </video>
Nov 06 06:03:57 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:03:57 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:03:57 user nova-compute[74903]:     </rng>
Nov 06 06:03:57 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:03:57 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:03:57 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:03:57 user nova-compute[74903]:     </memballoon>
Nov 06 06:03:57 user nova-compute[74903]:   </devices>
Nov 06 06:03:57 user nova-compute[74903]: </domain>
Nov 06 06:03:57 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1447677904',display_name='tempest-ServerRescueNegativeTestJSON-server-1447677904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1447677904',id=23,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgW7PD81gI6GHkukGSC3wfWAkjxfJo5pr60EENpM4Z2HWRRQosxm5AXbGhgCV2qNZWJWB6YrehuBw7yS4U+q6mCAMU8o1nME88e5r9FVjP00P90vhBUkLBsd9SnMtA+4w==',key_name='tempest-keypair-970855336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-wvxbg2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a651fca6654461c81036f79a46892ef',uuid=457a1716-198e-4054-b665-9e9af54f8c09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG os_vif [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e9b731-03b6-59a5-99d6-4a8ae1dc7faa', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63e0d648-65, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63e0d648-65, col_values=(('qos', UUID('37f544da-c485-431b-a1bd-de022ff83f65')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63e0d648-65, col_values=(('external_ids', {'iface-id': '63e0d648-6523-4aa2-8200-7f3e73a45080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:d1:48', 'vm-uuid': '457a1716-198e-4054-b665-9e9af54f8c09'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: INFO os_vif [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65')
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:a4:d1:48, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updated VIF entry in instance network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-393806ef-48de-4355-9900-5dc4ea788b53 req-3c2364f3-83ef-4e4d-95f9-a4efdc62617e service nova] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:03:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] No waiting events found dispatching network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:59 user nova-compute[74903]: WARNING nova.compute.manager [req-aa5ec878-e39e-4bf5-b973-a1c5e71c2eb2 req-59acd64e-a34d-41cc-bff9-328a28606a01 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received unexpected event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf for instance with vm_state building and task_state spawning.
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:03:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Instance spawned successfully.
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:03:59 user nova-compute[74903]: WARNING nova.compute.manager [req-0bac6653-c602-4455-a8fa-4854be4c2103 req-80455d2a-299c-4bef-9b49-fb571780f5e5 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state building and task_state spawning.
Nov 06 06:03:59 user nova-compute[74903]: INFO nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 06 06:03:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:03:59 user nova-compute[74903]: INFO nova.compute.manager [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Took 6.89 seconds to build instance.
Nov 06 06:03:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-51918f49-d391-4ebe-819e-ce52fa73a531 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.037s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:01 user nova-compute[74903]: WARNING nova.compute.manager [req-64d25223-27ec-4579-a287-7829d8c7383a req-f43642ce-709b-40b2-980c-fb5a5da03795 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state building and task_state spawning.
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:04:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance spawned successfully.
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:01 user nova-compute[74903]: INFO nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 06 06:04:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:04:01 user nova-compute[74903]: INFO nova.compute.manager [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Took 7.42 seconds to build instance.
Nov 06 06:04:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d1098d8e-356c-4143-afd7-75c6f5808032 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.547s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'serial': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6b060355-7015-4a5f-a3a4-4a870eab766e', 'serial'} {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:09 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046219d-4f6c-4bb6-b176-ff4945cf91c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:04:09 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6fb98b-8a91-4865-82f4-cad9155be6c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3] added
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a1c76-951c-4c8f-99b5-da0741e6cdd2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1595308-0202-4e8c-a27c-dd99033198ca]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAHKoWDp {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eAHKoWDp" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[127b0a2c-6cbd-4fca-bcfc-aefcc1d74340]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eAHKoWDp'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2704886-e3fd-4526-be33-c671090bd68d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef542ac-9524-4d59-8d5b-a2c65f85f18c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6071e7-6342-49ca-96f6-efc062558cd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260]
Nov 06 06:04:09 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaba07ab-1192-421b-bdaa-54eca61deac5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b944fa-1edd-414c-ab99-c9057cecc1af]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a44e5a2-e972-44b2-9c79-abee76c7ae56]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:04:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26430643862393265', 'path': '/dev/sdg'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643862393265', 'path': '/dev/sdg'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:04:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lazy-loading 'flavor' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.413s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 487587840 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:04:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 722468864 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db is timed out.
Nov 06 06:04:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully detached device vdb from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the live domain config.
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUBonrtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.056s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc59aeb-aeb6-459d-8fae-8ac4daddc919]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:04:15 user nova-compute[74903]: No targets found.
Nov 06 06:04:15 user nova-compute[74903]: iSNS:
Nov 06 06:04:15 user nova-compute[74903]: No targets found.
Nov 06 06:04:15 user nova-compute[74903]: STATIC:
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:04:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:15 user nova-compute[74903]: FIRMWARE:
Nov 06 06:04:15 user nova-compute[74903]: No targets found.
Nov 06 06:04:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:04:15 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:04:15 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec039d-ac40-481e-8ff9-fe2655a3e759]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f849ef6a-4a71-4c9b-8d11-989ef29d2ead]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:15 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08614ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4012b6-decc-4378-ba44-5feb7cc8c747]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd01476-de6d-472d-865d-29597eaf7e85]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18ee227-93ef-4c46-b66a-61cba7323099]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d11eac-b362-47d1-9d83-a32b3c6c02de]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359deb6-c00d-4117-abb5-8f3fc8381511]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:04:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Creating image(s)
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Ensure instance console log exists: /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start _get_guest_xml network_info=[{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4c9a4d3-6553-48f6-85b1-00d9c905cc50', 'attached_at': '', 'detached_at': '', 'volume_id': '1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'serial': '1b89cecf-83ad-413d-ad2c-db8205ab62a9'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '71072b4b-10e8-4d6c-82d0-793dccd89169', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e3f43e-ba71-4ee7-95b1-6670c1f23ecb]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260]
Nov 06 06:04:15 user nova-compute[74903]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:15 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75c579f1-66a4-4718-bee8-b5220b336215 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7099efb-b15b-4f0c-bd94-1e7eb4d1aa18]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.595s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] <== disconnect_volume: return (598ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.017s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:15 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e188c4-3f1f-46ae-84cf-0b2d4e12ee14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:04:15 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5a0917-8a76-4818-bacb-34db518fd384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9] added
Nov 06 06:04:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f09d9d-5bbc-40b4-ae2f-3811e3fcefa1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac953a-fd31-45a7-a938-9675353750cf]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWzdIsUr {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWzdIsUr" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9232f58-e6e6-4222-a656-f79875b06738]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWzdIsUr'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83582dbe-7502-4ce5-be0f-8d2010f84755]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b7e78-8758-4f7e-9dac-9fae59b3ec78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:16 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:16 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:16 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6b5ffa74-e5e9-4187-a274-e3539ff5923c tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.457s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --login" returned: 0 in 1.080s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3a4c8-a3fe-4d3c-ad89-22bea6529bb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]
Nov 06 06:04:17 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdeee8d-c872-4e36-abab-98aca4dc90ff]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef0ab9a-2031-4360-a7b1-9a5021782501]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:17 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:17 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.400s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53786320-06d0-47b0-853d-8c3a5bce4420]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-75369dce-72cd-4324-8a18-7d77e444964b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-75369dce-72cd-4324-8a18-7d77e444964b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.objects.instance [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Attempting to detach device tap75369dce-72 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] detach device xml: <interface type="ethernet">
Nov 06 06:04:17 user nova-compute[74903]:   <mac address="fa:16:3e:3f:2a:a1"/>
Nov 06 06:04:17 user nova-compute[74903]:   <model type="virtio"/>
Nov 06 06:04:17 user nova-compute[74903]:   <mtu size="1442"/>
Nov 06 06:04:17 user nova-compute[74903]:   <target dev="tap75369dce-72"/>
Nov 06 06:04:17 user nova-compute[74903]: </interface>
Nov 06 06:04:17 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 06 06:04:17 user nova-compute[74903]:   <name>instance-00000012</name>
Nov 06 06:04:17 user nova-compute[74903]:   <uuid>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</uuid>
Nov 06 06:04:17 user nova-compute[74903]:   <metadata>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:17 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:03:25</nova:creationTime>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:17 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:17 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:17 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:17 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:17 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:17 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:17 user nova-compute[74903]:     <nova:port uuid="75369dce-72cd-4324-8a18-7d77e444964b">
Nov 06 06:04:17 user nova-compute[74903]:       <nova:ip type="fixed" address="10.10.10.5" ipVersion="4"/>
Nov 06 06:04:17 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:17 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:17 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:17 user nova-compute[74903]:   </metadata>
Nov 06 06:04:17 user nova-compute[74903]:   <memory unit='KiB'>524288</memory>
Nov 06 06:04:17 user nova-compute[74903]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 06:04:17 user nova-compute[74903]:   <vcpu placement='static'>1</vcpu>
Nov 06 06:04:17 user nova-compute[74903]:   <resource>
Nov 06 06:04:17 user nova-compute[74903]:     <partition>/machine</partition>
Nov 06 06:04:17 user nova-compute[74903]:   </resource>
Nov 06 06:04:17 user nova-compute[74903]:   <sysinfo type='smbios'>
Nov 06 06:04:17 user nova-compute[74903]:     <system>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='version'>0.0.0</entry>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='serial'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='uuid'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:17 user nova-compute[74903]:       <entry name='family'>Virtual Machine</entry>
Nov 06 06:04:17 user nova-compute[74903]:     </system>
Nov 06 06:04:17 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:17 user nova-compute[74903]:   <os>
Nov 06 06:04:17 user nova-compute[74903]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 06:04:17 user nova-compute[74903]:     <boot dev='hd'/>
Nov 06 06:04:17 user nova-compute[74903]:     <smbios mode='sysinfo'/>
Nov 06 06:04:17 user nova-compute[74903]:   </os>
Nov 06 06:04:17 user nova-compute[74903]:   <features>
Nov 06 06:04:17 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:17 user nova-compute[74903]:     <apic/>
Nov 06 06:04:17 user nova-compute[74903]:     <vmcoreinfo state='on'/>
Nov 06 06:04:17 user nova-compute[74903]:   </features>
Nov 06 06:04:17 user nova-compute[74903]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 06:04:17 user nova-compute[74903]:     <model fallback='forbid'>Nehalem</model>
Nov 06 06:04:17 user nova-compute[74903]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 06:04:17 user nova-compute[74903]:     <feature policy='require' name='vme'/>
Nov 06 06:04:17 user nova-compute[74903]:     <feature policy='require' name='x2apic'/>
Nov 06 06:04:17 user nova-compute[74903]:     <feature policy='require' name='hypervisor'/>
Nov 06 06:04:17 user nova-compute[74903]:   </cpu>
Nov 06 06:04:17 user nova-compute[74903]:   <clock offset='utc'>
Nov 06 06:04:17 user nova-compute[74903]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 06:04:17 user nova-compute[74903]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 06:04:17 user nova-compute[74903]:     <timer name='hpet' present='no'/>
Nov 06 06:04:17 user nova-compute[74903]:   </clock>
Nov 06 06:04:17 user nova-compute[74903]:   <on_poweroff>destroy</on_poweroff>
Nov 06 06:04:17 user nova-compute[74903]:   <on_reboot>restart</on_reboot>
Nov 06 06:04:17 user nova-compute[74903]:   <on_crash>destroy</on_crash>
Nov 06 06:04:17 user nova-compute[74903]:   <devices>
Nov 06 06:04:17 user nova-compute[74903]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 06:04:17 user nova-compute[74903]:     <disk type='file' device='disk'>
Nov 06 06:04:17 user nova-compute[74903]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 06:04:17 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk' index='2'/>
Nov 06 06:04:17 user nova-compute[74903]:       <backingStore type='file' index='3'>
Nov 06 06:04:17 user nova-compute[74903]:         <format type='raw'/>
Nov 06 06:04:17 user nova-compute[74903]:         <source file='/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da'/>
Nov 06 06:04:17 user nova-compute[74903]:         <backingStore/>
Nov 06 06:04:17 user nova-compute[74903]:       </backingStore>
Nov 06 06:04:17 user nova-compute[74903]:       <target dev='vda' bus='virtio'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='virtio-disk0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </disk>
Nov 06 06:04:17 user nova-compute[74903]:     <disk type='file' device='cdrom'>
Nov 06 06:04:17 user nova-compute[74903]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 06:04:17 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config' index='1'/>
Nov 06 06:04:17 user nova-compute[74903]:       <backingStore/>
Nov 06 06:04:17 user nova-compute[74903]:       <target dev='hda' bus='ide'/>
Nov 06 06:04:17 user nova-compute[74903]:       <readonly/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='ide0-0-0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </disk>
Nov 06 06:04:17 user nova-compute[74903]:     <controller type='usb' index='0' model='none'>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='usb'/>
Nov 06 06:04:17 user nova-compute[74903]:     </controller>
Nov 06 06:04:17 user nova-compute[74903]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='pci.0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </controller>
Nov 06 06:04:17 user nova-compute[74903]:     <controller type='ide' index='0'>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='ide'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 06:04:17 user nova-compute[74903]:     </controller>
Nov 06 06:04:17 user nova-compute[74903]:     <interface type='ethernet'>
Nov 06 06:04:17 user nova-compute[74903]:       <mac address='fa:16:3e:1b:a5:de'/>
Nov 06 06:04:17 user nova-compute[74903]:       <target dev='tapbe91300f-ea'/>
Nov 06 06:04:17 user nova-compute[74903]:       <model type='virtio'/>
Nov 06 06:04:17 user nova-compute[74903]:       <mtu size='1442'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='net0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </interface>
Nov 06 06:04:17 user nova-compute[74903]:     <interface type='ethernet'>
Nov 06 06:04:17 user nova-compute[74903]:       <mac address='fa:16:3e:3f:2a:a1'/>
Nov 06 06:04:17 user nova-compute[74903]:       <target dev='tap75369dce-72'/>
Nov 06 06:04:17 user nova-compute[74903]:       <model type='virtio'/>
Nov 06 06:04:17 user nova-compute[74903]:       <mtu size='1442'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='net1'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </interface>
Nov 06 06:04:17 user nova-compute[74903]:     <serial type='pty'>
Nov 06 06:04:17 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:17 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:17 user nova-compute[74903]:       <target type='isa-serial' port='0'>
Nov 06 06:04:17 user nova-compute[74903]:         <model name='isa-serial'/>
Nov 06 06:04:17 user nova-compute[74903]:       </target>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </serial>
Nov 06 06:04:17 user nova-compute[74903]:     <console type='pty' tty='/dev/pts/6'>
Nov 06 06:04:17 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:17 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:17 user nova-compute[74903]:       <target type='serial' port='0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </console>
Nov 06 06:04:17 user nova-compute[74903]:     <input type='mouse' bus='ps2'>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='input0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </input>
Nov 06 06:04:17 user nova-compute[74903]:     <input type='keyboard' bus='ps2'>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='input1'/>
Nov 06 06:04:17 user nova-compute[74903]:     </input>
Nov 06 06:04:17 user nova-compute[74903]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 06 06:04:17 user nova-compute[74903]:       <listen type='address' address='0.0.0.0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </graphics>
Nov 06 06:04:17 user nova-compute[74903]:     <audio id='1' type='none'/>
Nov 06 06:04:17 user nova-compute[74903]:     <video>
Nov 06 06:04:17 user nova-compute[74903]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='video0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </video>
Nov 06 06:04:17 user nova-compute[74903]:     <memballoon model='virtio'>
Nov 06 06:04:17 user nova-compute[74903]:       <stats period='10'/>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='balloon0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:17 user nova-compute[74903]:     <rng model='virtio'>
Nov 06 06:04:17 user nova-compute[74903]:       <backend model='random'>/dev/urandom</backend>
Nov 06 06:04:17 user nova-compute[74903]:       <alias name='rng0'/>
Nov 06 06:04:17 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 06:04:17 user nova-compute[74903]:     </rng>
Nov 06 06:04:17 user nova-compute[74903]:   </devices>
Nov 06 06:04:17 user nova-compute[74903]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 06:04:17 user nova-compute[74903]:     <label>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</label>
Nov 06 06:04:17 user nova-compute[74903]:     <imagelabel>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</imagelabel>
Nov 06 06:04:17 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:17 user nova-compute[74903]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 06:04:17 user nova-compute[74903]:     <label>+64055:+108</label>
Nov 06 06:04:17 user nova-compute[74903]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 06:04:17 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:17 user nova-compute[74903]: </domain>
Nov 06 06:04:17 user nova-compute[74903]:  {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 06:04:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully detached device tap75369dce-72 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the persistent domain config.
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] (1/8): Attempting to detach device tap75369dce-72 with device alias net1 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] detach device xml: <interface type="ethernet">
Nov 06 06:04:17 user nova-compute[74903]:   <mac address="fa:16:3e:3f:2a:a1"/>
Nov 06 06:04:17 user nova-compute[74903]:   <model type="virtio"/>
Nov 06 06:04:17 user nova-compute[74903]:   <mtu size="1442"/>
Nov 06 06:04:17 user nova-compute[74903]:   <target dev="tap75369dce-72"/>
Nov 06 06:04:17 user nova-compute[74903]: </interface>
Nov 06 06:04:17 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Start waiting for the detach event from libvirt for device tap75369dce-72 with device alias net1 for instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-unplugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-unplugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:18 user nova-compute[74903]: WARNING nova.compute.manager [req-260472df-8562-4a7d-991d-4eadb12aeba3 req-8a9dca1e-d7bd-4dab-aa0f-01280888cf50 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-unplugged-75369dce-72cd-4324-8a18-7d77e444964b for instance with vm_state active and task_state None.
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.439s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== connect_volume: return (2459ms) {'type': 'block', 'scsi_wwn': '26266343930346535', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343930346535', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.440s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpweiMHBr6jQ+m9OIYh7A/g+dNeJ/4KwTlhdSahFJAu3qKEWlBKpnoUpoGy1+sEGUfR/oA1LSExC4cUGfqlVDNGqMM769vNAXCBv/ZqxlXj+kYUtmAflt1VH5R0oPJU8A==',key_name='tempest-TestShelveInstance-2063912077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:48Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'pci_devices' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece0689e-df16-443c-92c0-33a6083aa963]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:04:18 user nova-compute[74903]: No targets found.
Nov 06 06:04:18 user nova-compute[74903]: iSNS:
Nov 06 06:04:18 user nova-compute[74903]: No targets found.
Nov 06 06:04:18 user nova-compute[74903]: STATIC:
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:04:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:18 user nova-compute[74903]: FIRMWARE:
Nov 06 06:04:18 user nova-compute[74903]: No targets found.
Nov 06 06:04:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:04:18 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:04:18 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:04:18 user nova-compute[74903]:   <uuid>c4c9a4d3-6553-48f6-85b1-00d9c905cc50</uuid>
Nov 06 06:04:18 user nova-compute[74903]:   <name>instance-00000015</name>
Nov 06 06:04:18 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:04:18 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:04:18 user nova-compute[74903]:   <metadata>
Nov 06 06:04:18 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:18 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:04:18 user nova-compute[74903]:       <nova:name>tempest-TestShelveInstance-server-865305500</nova:name>
Nov 06 06:04:18 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:04:15</nova:creationTime>
Nov 06 06:04:18 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:04:18 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:18 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:04:18 user nova-compute[74903]:       <nova:owner>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:user uuid="9f23b6ac95ae4183a9f74b1927407f2e">tempest-TestShelveInstance-1152944910-project-member</nova:user>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:project uuid="90ac1d35737f4599bfc799afb620174c">tempest-TestShelveInstance-1152944910</nova:project>
Nov 06 06:04:18 user nova-compute[74903]:       </nova:owner>
Nov 06 06:04:18 user nova-compute[74903]:       <nova:ports>
Nov 06 06:04:18 user nova-compute[74903]:         <nova:port uuid="b35081d0-53fc-4c39-a633-7ce512bfc52f">
Nov 06 06:04:18 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 06:04:18 user nova-compute[74903]:         </nova:port>
Nov 06 06:04:18 user nova-compute[74903]:       </nova:ports>
Nov 06 06:04:18 user nova-compute[74903]:     </nova:instance>
Nov 06 06:04:18 user nova-compute[74903]:   </metadata>
Nov 06 06:04:18 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:04:18 user nova-compute[74903]:     <system>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="serial">c4c9a4d3-6553-48f6-85b1-00d9c905cc50</entry>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="uuid">c4c9a4d3-6553-48f6-85b1-00d9c905cc50</entry>
Nov 06 06:04:18 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:04:18 user nova-compute[74903]:     </system>
Nov 06 06:04:18 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:18 user nova-compute[74903]:   <os>
Nov 06 06:04:18 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:04:18 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:04:18 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:04:18 user nova-compute[74903]:   </os>
Nov 06 06:04:18 user nova-compute[74903]:   <features>
Nov 06 06:04:18 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:18 user nova-compute[74903]:     <apic/>
Nov 06 06:04:18 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:04:18 user nova-compute[74903]:   </features>
Nov 06 06:04:18 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:04:18 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:04:18 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:04:18 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:04:18 user nova-compute[74903]:   </clock>
Nov 06 06:04:18 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:04:18 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:04:18 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:04:18 user nova-compute[74903]:   </cpu>
Nov 06 06:04:18 user nova-compute[74903]:   <devices>
Nov 06 06:04:18 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:04:18 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:04:18 user nova-compute[74903]:       <source dev="/dev/sdf"/>
Nov 06 06:04:18 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:04:18 user nova-compute[74903]:       <serial>1b89cecf-83ad-413d-ad2c-db8205ab62a9</serial>
Nov 06 06:04:18 user nova-compute[74903]:     </disk>
Nov 06 06:04:18 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:04:18 user nova-compute[74903]:       <mac address="fa:16:3e:77:da:2c"/>
Nov 06 06:04:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:18 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:04:18 user nova-compute[74903]:       <target dev="tapb35081d0-53"/>
Nov 06 06:04:18 user nova-compute[74903]:     </interface>
Nov 06 06:04:18 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:04:18 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50/console.log" append="off"/>
Nov 06 06:04:18 user nova-compute[74903]:     </serial>
Nov 06 06:04:18 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:04:18 user nova-compute[74903]:     <video>
Nov 06 06:04:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:18 user nova-compute[74903]:     </video>
Nov 06 06:04:18 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:04:18 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:04:18 user nova-compute[74903]:     </rng>
Nov 06 06:04:18 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:04:18 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:04:18 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:04:18 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:18 user nova-compute[74903]:   </devices>
Nov 06 06:04:18 user nova-compute[74903]: </domain>
Nov 06 06:04:18 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpweiMHBr6jQ+m9OIYh7A/g+dNeJ/4KwTlhdSahFJAu3qKEWlBKpnoUpoGy1+sEGUfR/oA1LSExC4cUGfqlVDNGqMM769vNAXCBv/ZqxlXj+kYUtmAflt1VH5R0oPJU8A==',key_name='tempest-TestShelveInstance-2063912077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:03:48Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_vif [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dc6cfd-448f-415a-9a98-234be40d3002]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c13a7786-2f80-55a1-bc9d-128b99a7d536', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[251b036e-0e04-4103-a6a9-347f229497b2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:18 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085ff6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb35081d0-53, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb35081d0-53, col_values=(('qos', UUID('ec578268-360b-4f64-b0cd-840286afdf21')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb35081d0-53, col_values=(('external_ids', {'iface-id': 'b35081d0-53fc-4c39-a633-7ce512bfc52f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:da:2c', 'vm-uuid': 'c4c9a4d3-6553-48f6-85b1-00d9c905cc50'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[23668995-5e08-4662-a7df-cf4cc1c840f6]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:18 user nova-compute[74903]: INFO os_vif [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53')
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c74e6f0-dbcf-4e1c-9c91-805a607b66a6]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f67f2-835c-4693-abc9-8483bc6549d3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] No VIF found with MAC fa:16:3e:77:da:2c, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1fb2b-dd89-4ea1-88d5-a9ac5b37cd04]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ee6372-87ef-4cb4-aa25-fa5db9a0cdb5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[72626e98-87b1-434e-bab0-2c67556d39b7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]
Nov 06 06:04:18 user nova-compute[74903]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87677ae7-5537-4b02-85e6-2569d71de72e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== disconnect_volume: return (2883ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'serial'} {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 06:04:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: removing Cinder connection for volume 6b060355-7015-4a5f-a3a4-4a870eab766e {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: Updating volume 6b060355-7015-4a5f-a3a4-4a870eab766e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eAHKoWDp", "auth_password": "fST7MBHIlvnx1G", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "6a4b6937-bec6-4a46-a5b9-fe796e0a14d3"}, "status": "reserved", "instance": "b781713b-1c98-4674-901c-a834bf648636", "attached_at": "", "detached_at": "", "volume_id": "6a4b6937-bec6-4a46-a5b9-fe796e0a14d3", "serial": "6a4b6937-bec6-4a46-a5b9-fe796e0a14d3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'no_device': None, 'attachment_id': '717778a2-0290-4e07-a2fd-d13efe13af97'} {{(pid=74903) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:22 user nova-compute[74903]: WARNING nova.compute.manager [req-eff66e03-bb2a-468c-8026-163aa0b07f0b req-75a26971-10e8-4988-86e9-61e0c49b7504 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-75369dce-72cd-4324-8a18-7d77e444964b for instance with vm_state active and task_state None.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:22 user nova-compute[74903]: WARNING nova.compute.manager [req-4e4fd0dc-ef07-40a5-8c0e-c43e2054b06e req-d251ff13-0b35-43bc-bfbf-4dc91731a65e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state building and task_state spawning.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:22 user nova-compute[74903]: WARNING nova.compute.manager [req-cd6bcc7a-bf9e-4313-a44c-a7dd00e32a0e req-9b7e61da-d322-46d0-8a98-a0cadea4ceca service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state building and task_state spawning.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-61336fba-245a-4103-879e-bf777529ccc6 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 57.182s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:22 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:22 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=6932MB free_disk=25.29824447631836GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance spawned successfully.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.compute.manager [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Detaching volume 1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.virt.block_device [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Attempting to driver detach volume 1189533d-fb93-4a26-9488-3427e27f4b53 from mountpoint /dev/vdb
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Attempting to detach device vdb from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:04:22 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:04:22 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:04:22 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:04:22 user nova-compute[74903]:   <serial>1189533d-fb93-4a26-9488-3427e27f4b53</serial>
Nov 06 06:04:22 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:04:22 user nova-compute[74903]: </disk>
Nov 06 06:04:22 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully detached device vdb from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the persistent domain config.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:04:22 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:04:22 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:04:22 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:04:22 user nova-compute[74903]:   <serial>1189533d-fb93-4a26-9488-3427e27f4b53</serial>
Nov 06 06:04:22 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:04:22 user nova-compute[74903]: </disk>
Nov 06 06:04:22 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Took 7.02 seconds to spawn the instance on the hypervisor.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b2e140-f082-47b9-8347-25ad5123e39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance dee138d4-059b-489d-8122-cbb4b2c2112e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 6a685cae-989a-473d-80b9-ded3974de38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 510bcb77-b1fc-4009-a17e-8673dc9b77df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:04:22 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:04:22 user nova-compute[74903]: INFO nova.compute.manager [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Took 35.71 seconds to build instance.
Nov 06 06:04:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0b77fef-4c3a-44d4-8974-816c148ffa65 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.815s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.728s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:04:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:30 user nova-compute[74903]: INFO nova.compute.manager [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Detaching volume 9d372750-1b30-4c60-9328-ab8524db25f3
Nov 06 06:04:30 user nova-compute[74903]: INFO nova.virt.block_device [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Attempting to driver detach volume 9d372750-1b30-4c60-9328-ab8524db25f3 from mountpoint /dev/vdb
Nov 06 06:04:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Attempting to detach device vdb from instance 8239a418-b65a-4d4f-95dd-efe0e836403a from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:04:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:04:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:04:31 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:04:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:04:31 user nova-compute[74903]:   <serial>9d372750-1b30-4c60-9328-ab8524db25f3</serial>
Nov 06 06:04:31 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:04:31 user nova-compute[74903]: </disk>
Nov 06 06:04:31 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Successfully detached device vdb from instance 8239a418-b65a-4d4f-95dd-efe0e836403a from the persistent domain config.
Nov 06 06:04:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8239a418-b65a-4d4f-95dd-efe0e836403a from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:04:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:04:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:04:31 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:04:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:04:31 user nova-compute[74903]:   <serial>9d372750-1b30-4c60-9328-ab8524db25f3</serial>
Nov 06 06:04:31 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:04:31 user nova-compute[74903]: </disk>
Nov 06 06:04:31 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:04:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:04:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:04:33 user nova-compute[74903]: INFO nova.compute.claims [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Claim successful on node user
Nov 06 06:04:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:04:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:04:33 user nova-compute[74903]: DEBUG nova.policy [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d10322732ce4e93b049be06ad946cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af82cdc03f0241bb8de82b8fb9d7a66c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:04:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Creating image(s)
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.260s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.221s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Successfully created port: eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk 1073741824" returned: 0 in 0.069s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:34 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Cannot resize image /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Successfully updated port: eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-changed-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Refreshing instance network info cache due to event network-changed-eb3c49d0-5a46-446b-b594-6446e184d613. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] Acquiring lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Updating instance_info_cache with network_info: [{"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Instance network_info: |[{"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] Acquired lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Refreshing network info cache for port eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Start _get_guest_xml network_info=[{"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:04:35 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:35 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-60015138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-60015138',id=24,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-5zz82357',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:04:34Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=5b6b2cf0-a775-4119-a892-425c4e3a2cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:04:35 user nova-compute[74903]:   <uuid>5b6b2cf0-a775-4119-a892-425c4e3a2cb9</uuid>
Nov 06 06:04:35 user nova-compute[74903]:   <name>instance-00000018</name>
Nov 06 06:04:35 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:04:35 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:04:35 user nova-compute[74903]:   <metadata>
Nov 06 06:04:35 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:35 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-60015138</nova:name>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:04:35</nova:creationTime>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:04:35 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:35 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:owner>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 06:04:35 user nova-compute[74903]:       </nova:owner>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:35 user nova-compute[74903]:       <nova:ports>
Nov 06 06:04:35 user nova-compute[74903]:         <nova:port uuid="eb3c49d0-5a46-446b-b594-6446e184d613">
Nov 06 06:04:35 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 06:04:35 user nova-compute[74903]:         </nova:port>
Nov 06 06:04:35 user nova-compute[74903]:       </nova:ports>
Nov 06 06:04:35 user nova-compute[74903]:     </nova:instance>
Nov 06 06:04:35 user nova-compute[74903]:   </metadata>
Nov 06 06:04:35 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:04:35 user nova-compute[74903]:     <system>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="serial">5b6b2cf0-a775-4119-a892-425c4e3a2cb9</entry>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="uuid">5b6b2cf0-a775-4119-a892-425c4e3a2cb9</entry>
Nov 06 06:04:35 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:04:35 user nova-compute[74903]:     </system>
Nov 06 06:04:35 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:35 user nova-compute[74903]:   <os>
Nov 06 06:04:35 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:04:35 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:04:35 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:04:35 user nova-compute[74903]:   </os>
Nov 06 06:04:35 user nova-compute[74903]:   <features>
Nov 06 06:04:35 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:35 user nova-compute[74903]:     <apic/>
Nov 06 06:04:35 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:04:35 user nova-compute[74903]:   </features>
Nov 06 06:04:35 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:04:35 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:04:35 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:04:35 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:04:35 user nova-compute[74903]:   </clock>
Nov 06 06:04:35 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:04:35 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:04:35 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:04:35 user nova-compute[74903]:   </cpu>
Nov 06 06:04:35 user nova-compute[74903]:   <devices>
Nov 06 06:04:35 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:04:35 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:04:35 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk"/>
Nov 06 06:04:35 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:04:35 user nova-compute[74903]:     </disk>
Nov 06 06:04:35 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:04:35 user nova-compute[74903]:       <mac address="fa:16:3e:76:d9:5f"/>
Nov 06 06:04:35 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:35 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:04:35 user nova-compute[74903]:       <target dev="tapeb3c49d0-5a"/>
Nov 06 06:04:35 user nova-compute[74903]:     </interface>
Nov 06 06:04:35 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:04:35 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/console.log" append="off"/>
Nov 06 06:04:35 user nova-compute[74903]:     </serial>
Nov 06 06:04:35 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:04:35 user nova-compute[74903]:     <video>
Nov 06 06:04:35 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:35 user nova-compute[74903]:     </video>
Nov 06 06:04:35 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:04:35 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:04:35 user nova-compute[74903]:     </rng>
Nov 06 06:04:35 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:04:35 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:04:35 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:04:35 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:35 user nova-compute[74903]:   </devices>
Nov 06 06:04:35 user nova-compute[74903]: </domain>
Nov 06 06:04:35 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-60015138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-60015138',id=24,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-5zz82357',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:04:34Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=5b6b2cf0-a775-4119-a892-425c4e3a2cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG os_vif [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81a15d8a-1fbe-5e2d-9fa5-ce6d6f8e6b2f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb3c49d0-5a, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb3c49d0-5a, col_values=(('qos', UUID('511db34d-6572-4bcb-a860-c9fa740113de')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb3c49d0-5a, col_values=(('external_ids', {'iface-id': 'eb3c49d0-5a46-446b-b594-6446e184d613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:d9:5f', 'vm-uuid': '5b6b2cf0-a775-4119-a892-425c4e3a2cb9'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:35 user nova-compute[74903]: INFO os_vif [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a')
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:04:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:76:d9:5f, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:04:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Updated VIF entry in instance network info cache for port eb3c49d0-5a46-446b-b594-6446e184d613. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:04:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Updating instance_info_cache with network_info: [{"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cbf0ed0a-d1e7-415f-a1de-701b7a5ebf2f req-836a05b3-c66a-4552-9275-2ea1da1607a8 service nova] Releasing lock "refresh_cache-5b6b2cf0-a775-4119-a892-425c4e3a2cb9" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] No waiting events found dispatching network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:37 user nova-compute[74903]: WARNING nova.compute.manager [req-0cc3acd7-4cc2-462f-8b74-cccf0b2fdc88 req-2e7a6a8a-5715-4275-b9b5-ee907f36f25c service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received unexpected event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 for instance with vm_state building and task_state spawning.
Nov 06 06:04:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Waiting for libvirt event about the detach of device tap75369dce-72 with device alias net1 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db is timed out.
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 06 06:04:38 user nova-compute[74903]:   <name>instance-00000012</name>
Nov 06 06:04:38 user nova-compute[74903]:   <uuid>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</uuid>
Nov 06 06:04:38 user nova-compute[74903]:   <metadata>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:38 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:03:25</nova:creationTime>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:38 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="75369dce-72cd-4324-8a18-7d77e444964b">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.10.10.5" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:38 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:38 user nova-compute[74903]:   </metadata>
Nov 06 06:04:38 user nova-compute[74903]:   <memory unit='KiB'>524288</memory>
Nov 06 06:04:38 user nova-compute[74903]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 06:04:38 user nova-compute[74903]:   <vcpu placement='static'>1</vcpu>
Nov 06 06:04:38 user nova-compute[74903]:   <resource>
Nov 06 06:04:38 user nova-compute[74903]:     <partition>/machine</partition>
Nov 06 06:04:38 user nova-compute[74903]:   </resource>
Nov 06 06:04:38 user nova-compute[74903]:   <sysinfo type='smbios'>
Nov 06 06:04:38 user nova-compute[74903]:     <system>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='version'>0.0.0</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='serial'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='uuid'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='family'>Virtual Machine</entry>
Nov 06 06:04:38 user nova-compute[74903]:     </system>
Nov 06 06:04:38 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:38 user nova-compute[74903]:   <os>
Nov 06 06:04:38 user nova-compute[74903]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 06:04:38 user nova-compute[74903]:     <boot dev='hd'/>
Nov 06 06:04:38 user nova-compute[74903]:     <smbios mode='sysinfo'/>
Nov 06 06:04:38 user nova-compute[74903]:   </os>
Nov 06 06:04:38 user nova-compute[74903]:   <features>
Nov 06 06:04:38 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:38 user nova-compute[74903]:     <apic/>
Nov 06 06:04:38 user nova-compute[74903]:     <vmcoreinfo state='on'/>
Nov 06 06:04:38 user nova-compute[74903]:   </features>
Nov 06 06:04:38 user nova-compute[74903]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 06:04:38 user nova-compute[74903]:     <model fallback='forbid'>Nehalem</model>
Nov 06 06:04:38 user nova-compute[74903]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='vme'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='x2apic'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='hypervisor'/>
Nov 06 06:04:38 user nova-compute[74903]:   </cpu>
Nov 06 06:04:38 user nova-compute[74903]:   <clock offset='utc'>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='hpet' present='no'/>
Nov 06 06:04:38 user nova-compute[74903]:   </clock>
Nov 06 06:04:38 user nova-compute[74903]:   <on_poweroff>destroy</on_poweroff>
Nov 06 06:04:38 user nova-compute[74903]:   <on_reboot>restart</on_reboot>
Nov 06 06:04:38 user nova-compute[74903]:   <on_crash>destroy</on_crash>
Nov 06 06:04:38 user nova-compute[74903]:   <devices>
Nov 06 06:04:38 user nova-compute[74903]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='disk'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk' index='2'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore type='file' index='3'>
Nov 06 06:04:38 user nova-compute[74903]:         <format type='raw'/>
Nov 06 06:04:38 user nova-compute[74903]:         <source file='/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da'/>
Nov 06 06:04:38 user nova-compute[74903]:         <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       </backingStore>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='vda' bus='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='virtio-disk0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='cdrom'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config' index='1'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='hda' bus='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <readonly/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide0-0-0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='usb' index='0' model='none'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='usb'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='pci.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='ide' index='0'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <interface type='ethernet'>
Nov 06 06:04:38 user nova-compute[74903]:       <mac address='fa:16:3e:1b:a5:de'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='tapbe91300f-ea'/>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <mtu size='1442'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='net0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </interface>
Nov 06 06:04:38 user nova-compute[74903]:     <serial type='pty'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='isa-serial' port='0'>
Nov 06 06:04:38 user nova-compute[74903]:         <model name='isa-serial'/>
Nov 06 06:04:38 user nova-compute[74903]:       </target>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </serial>
Nov 06 06:04:38 user nova-compute[74903]:     <console type='pty' tty='/dev/pts/6'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='serial' port='0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </console>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='mouse' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='keyboard' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 06 06:04:38 user nova-compute[74903]:       <listen type='address' address='0.0.0.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </graphics>
Nov 06 06:04:38 user nova-compute[74903]:     <audio id='1' type='none'/>
Nov 06 06:04:38 user nova-compute[74903]:     <video>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='video0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </video>
Nov 06 06:04:38 user nova-compute[74903]:     <memballoon model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <stats period='10'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='balloon0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:38 user nova-compute[74903]:     <rng model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <backend model='random'>/dev/urandom</backend>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='rng0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </rng>
Nov 06 06:04:38 user nova-compute[74903]:   </devices>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>+64055:+108</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]: </domain>
Nov 06 06:04:38 user nova-compute[74903]:  {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 06:04:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully detached device tap75369dce-72 from instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db from the live domain config.
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG os_vif [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75369dce-72, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=515b3ef5-934a-4d47-afd5-7f2129b254a7) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:38 user nova-compute[74903]: INFO os_vif [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72')
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:38 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:04:38</nova:creationTime>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:38 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:38 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:38 user nova-compute[74903]:  {{(pid=74903) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-deleted-75369dce-72cd-4324-8a18-7d77e444964b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:38 user nova-compute[74903]: INFO nova.compute.manager [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Neutron deleted interface 75369dce-72cd-4324-8a18-7d77e444964b; detaching it from the instance and deleting it from the info cache
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.neutron [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquired lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.objects.instance [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Lazy-loading 'system_metadata' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.objects.instance [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Lazy-loading 'flavor' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.objects.base [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Object Instance<5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db> lazy-loaded attributes: system_metadata,flavor {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 06 06:04:38 user nova-compute[74903]:   <name>instance-00000012</name>
Nov 06 06:04:38 user nova-compute[74903]:   <uuid>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</uuid>
Nov 06 06:04:38 user nova-compute[74903]:   <metadata>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:38 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:04:38</nova:creationTime>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:38 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:38 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:38 user nova-compute[74903]:   </metadata>
Nov 06 06:04:38 user nova-compute[74903]:   <memory unit='KiB'>524288</memory>
Nov 06 06:04:38 user nova-compute[74903]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 06:04:38 user nova-compute[74903]:   <vcpu placement='static'>1</vcpu>
Nov 06 06:04:38 user nova-compute[74903]:   <resource>
Nov 06 06:04:38 user nova-compute[74903]:     <partition>/machine</partition>
Nov 06 06:04:38 user nova-compute[74903]:   </resource>
Nov 06 06:04:38 user nova-compute[74903]:   <sysinfo type='smbios'>
Nov 06 06:04:38 user nova-compute[74903]:     <system>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='version'>0.0.0</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='serial'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='uuid'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='family'>Virtual Machine</entry>
Nov 06 06:04:38 user nova-compute[74903]:     </system>
Nov 06 06:04:38 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:38 user nova-compute[74903]:   <os>
Nov 06 06:04:38 user nova-compute[74903]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 06:04:38 user nova-compute[74903]:     <boot dev='hd'/>
Nov 06 06:04:38 user nova-compute[74903]:     <smbios mode='sysinfo'/>
Nov 06 06:04:38 user nova-compute[74903]:   </os>
Nov 06 06:04:38 user nova-compute[74903]:   <features>
Nov 06 06:04:38 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:38 user nova-compute[74903]:     <apic/>
Nov 06 06:04:38 user nova-compute[74903]:     <vmcoreinfo state='on'/>
Nov 06 06:04:38 user nova-compute[74903]:   </features>
Nov 06 06:04:38 user nova-compute[74903]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 06:04:38 user nova-compute[74903]:     <model fallback='forbid'>Nehalem</model>
Nov 06 06:04:38 user nova-compute[74903]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='vme'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='x2apic'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='hypervisor'/>
Nov 06 06:04:38 user nova-compute[74903]:   </cpu>
Nov 06 06:04:38 user nova-compute[74903]:   <clock offset='utc'>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='hpet' present='no'/>
Nov 06 06:04:38 user nova-compute[74903]:   </clock>
Nov 06 06:04:38 user nova-compute[74903]:   <on_poweroff>destroy</on_poweroff>
Nov 06 06:04:38 user nova-compute[74903]:   <on_reboot>restart</on_reboot>
Nov 06 06:04:38 user nova-compute[74903]:   <on_crash>destroy</on_crash>
Nov 06 06:04:38 user nova-compute[74903]:   <devices>
Nov 06 06:04:38 user nova-compute[74903]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='disk'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk' index='2'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore type='file' index='3'>
Nov 06 06:04:38 user nova-compute[74903]:         <format type='raw'/>
Nov 06 06:04:38 user nova-compute[74903]:         <source file='/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da'/>
Nov 06 06:04:38 user nova-compute[74903]:         <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       </backingStore>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='vda' bus='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='virtio-disk0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='cdrom'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config' index='1'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='hda' bus='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <readonly/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide0-0-0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='usb' index='0' model='none'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='usb'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='pci.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='ide' index='0'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <interface type='ethernet'>
Nov 06 06:04:38 user nova-compute[74903]:       <mac address='fa:16:3e:1b:a5:de'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='tapbe91300f-ea'/>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <mtu size='1442'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='net0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </interface>
Nov 06 06:04:38 user nova-compute[74903]:     <serial type='pty'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='isa-serial' port='0'>
Nov 06 06:04:38 user nova-compute[74903]:         <model name='isa-serial'/>
Nov 06 06:04:38 user nova-compute[74903]:       </target>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </serial>
Nov 06 06:04:38 user nova-compute[74903]:     <console type='pty' tty='/dev/pts/6'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='serial' port='0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </console>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='mouse' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='keyboard' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 06 06:04:38 user nova-compute[74903]:       <listen type='address' address='0.0.0.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </graphics>
Nov 06 06:04:38 user nova-compute[74903]:     <audio id='1' type='none'/>
Nov 06 06:04:38 user nova-compute[74903]:     <video>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='video0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </video>
Nov 06 06:04:38 user nova-compute[74903]:     <memballoon model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <stats period='10'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='balloon0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:38 user nova-compute[74903]:     <rng model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <backend model='random'>/dev/urandom</backend>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='rng0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </rng>
Nov 06 06:04:38 user nova-compute[74903]:   </devices>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>+64055:+108</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]: </domain>
Nov 06 06:04:38 user nova-compute[74903]:  {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface> {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3f:2a:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap75369dce-72"/></interface>not found in domain: <domain type='kvm' id='21'>
Nov 06 06:04:38 user nova-compute[74903]:   <name>instance-00000012</name>
Nov 06 06:04:38 user nova-compute[74903]:   <uuid>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</uuid>
Nov 06 06:04:38 user nova-compute[74903]:   <metadata>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:38 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:04:38</nova:creationTime>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:38 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:38 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:38 user nova-compute[74903]:   </metadata>
Nov 06 06:04:38 user nova-compute[74903]:   <memory unit='KiB'>524288</memory>
Nov 06 06:04:38 user nova-compute[74903]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 06:04:38 user nova-compute[74903]:   <vcpu placement='static'>1</vcpu>
Nov 06 06:04:38 user nova-compute[74903]:   <resource>
Nov 06 06:04:38 user nova-compute[74903]:     <partition>/machine</partition>
Nov 06 06:04:38 user nova-compute[74903]:   </resource>
Nov 06 06:04:38 user nova-compute[74903]:   <sysinfo type='smbios'>
Nov 06 06:04:38 user nova-compute[74903]:     <system>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='version'>0.0.0</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='serial'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='uuid'>5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</entry>
Nov 06 06:04:38 user nova-compute[74903]:       <entry name='family'>Virtual Machine</entry>
Nov 06 06:04:38 user nova-compute[74903]:     </system>
Nov 06 06:04:38 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:38 user nova-compute[74903]:   <os>
Nov 06 06:04:38 user nova-compute[74903]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 06:04:38 user nova-compute[74903]:     <boot dev='hd'/>
Nov 06 06:04:38 user nova-compute[74903]:     <smbios mode='sysinfo'/>
Nov 06 06:04:38 user nova-compute[74903]:   </os>
Nov 06 06:04:38 user nova-compute[74903]:   <features>
Nov 06 06:04:38 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:38 user nova-compute[74903]:     <apic/>
Nov 06 06:04:38 user nova-compute[74903]:     <vmcoreinfo state='on'/>
Nov 06 06:04:38 user nova-compute[74903]:   </features>
Nov 06 06:04:38 user nova-compute[74903]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 06:04:38 user nova-compute[74903]:     <model fallback='forbid'>Nehalem</model>
Nov 06 06:04:38 user nova-compute[74903]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='vme'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='x2apic'/>
Nov 06 06:04:38 user nova-compute[74903]:     <feature policy='require' name='hypervisor'/>
Nov 06 06:04:38 user nova-compute[74903]:   </cpu>
Nov 06 06:04:38 user nova-compute[74903]:   <clock offset='utc'>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 06:04:38 user nova-compute[74903]:     <timer name='hpet' present='no'/>
Nov 06 06:04:38 user nova-compute[74903]:   </clock>
Nov 06 06:04:38 user nova-compute[74903]:   <on_poweroff>destroy</on_poweroff>
Nov 06 06:04:38 user nova-compute[74903]:   <on_reboot>restart</on_reboot>
Nov 06 06:04:38 user nova-compute[74903]:   <on_crash>destroy</on_crash>
Nov 06 06:04:38 user nova-compute[74903]:   <devices>
Nov 06 06:04:38 user nova-compute[74903]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='disk'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk' index='2'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore type='file' index='3'>
Nov 06 06:04:38 user nova-compute[74903]:         <format type='raw'/>
Nov 06 06:04:38 user nova-compute[74903]:         <source file='/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da'/>
Nov 06 06:04:38 user nova-compute[74903]:         <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       </backingStore>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='vda' bus='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='virtio-disk0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <disk type='file' device='cdrom'>
Nov 06 06:04:38 user nova-compute[74903]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 06:04:38 user nova-compute[74903]:       <source file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/disk.config' index='1'/>
Nov 06 06:04:38 user nova-compute[74903]:       <backingStore/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='hda' bus='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <readonly/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide0-0-0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </disk>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='usb' index='0' model='none'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='usb'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='pci.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <controller type='ide' index='0'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='ide'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </controller>
Nov 06 06:04:38 user nova-compute[74903]:     <interface type='ethernet'>
Nov 06 06:04:38 user nova-compute[74903]:       <mac address='fa:16:3e:1b:a5:de'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target dev='tapbe91300f-ea'/>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio'/>
Nov 06 06:04:38 user nova-compute[74903]:       <mtu size='1442'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='net0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </interface>
Nov 06 06:04:38 user nova-compute[74903]:     <serial type='pty'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='isa-serial' port='0'>
Nov 06 06:04:38 user nova-compute[74903]:         <model name='isa-serial'/>
Nov 06 06:04:38 user nova-compute[74903]:       </target>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </serial>
Nov 06 06:04:38 user nova-compute[74903]:     <console type='pty' tty='/dev/pts/6'>
Nov 06 06:04:38 user nova-compute[74903]:       <source path='/dev/pts/6'/>
Nov 06 06:04:38 user nova-compute[74903]:       <log file='/opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db/console.log' append='off'/>
Nov 06 06:04:38 user nova-compute[74903]:       <target type='serial' port='0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='serial0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </console>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='mouse' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <input type='keyboard' bus='ps2'>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='input1'/>
Nov 06 06:04:38 user nova-compute[74903]:     </input>
Nov 06 06:04:38 user nova-compute[74903]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 06 06:04:38 user nova-compute[74903]:       <listen type='address' address='0.0.0.0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </graphics>
Nov 06 06:04:38 user nova-compute[74903]:     <audio id='1' type='none'/>
Nov 06 06:04:38 user nova-compute[74903]:     <video>
Nov 06 06:04:38 user nova-compute[74903]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='video0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </video>
Nov 06 06:04:38 user nova-compute[74903]:     <memballoon model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <stats period='10'/>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='balloon0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:38 user nova-compute[74903]:     <rng model='virtio'>
Nov 06 06:04:38 user nova-compute[74903]:       <backend model='random'>/dev/urandom</backend>
Nov 06 06:04:38 user nova-compute[74903]:       <alias name='rng0'/>
Nov 06 06:04:38 user nova-compute[74903]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 06:04:38 user nova-compute[74903]:     </rng>
Nov 06 06:04:38 user nova-compute[74903]:   </devices>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>libvirt-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 06:04:38 user nova-compute[74903]:     <label>+64055:+108</label>
Nov 06 06:04:38 user nova-compute[74903]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 06:04:38 user nova-compute[74903]:   </seclabel>
Nov 06 06:04:38 user nova-compute[74903]: </domain>
Nov 06 06:04:38 user nova-compute[74903]:  {{(pid=74903) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 06:04:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Detaching interface fa:16:3e:3f:2a:a1 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap75369dce-72' not found.
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Converting VIF {"id": "75369dce-72cd-4324-8a18-7d77e444964b", "address": "fa:16:3e:3f:2a:a1", "network": {"id": "d08e668a-40bf-4bde-b74f-dd838c447ede", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2124833216", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75369dce-72", "ovs_interfaceid": "75369dce-72cd-4324-8a18-7d77e444964b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG os_vif [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75369dce-72, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:04:38 user nova-compute[74903]: INFO os_vif [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:2a:a1,bridge_name='br-int',has_traffic_filtering=True,id=75369dce-72cd-4324-8a18-7d77e444964b,network=Network(d08e668a-40bf-4bde-b74f-dd838c447ede),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75369dce-72')
Nov 06 06:04:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [req-bd59d400-e674-4b7a-b710-5541cb34b878 req-01daf3cb-3633-4d90-8cfb-08aa558f46dd service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:38 user nova-compute[74903]:   <nova:package version="0.0.0"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:name>tempest-device-tagging-server-1984165036</nova:name>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:creationTime>2023-11-06 06:04:38</nova:creationTime>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:flavor name="m1.tiny">
Nov 06 06:04:38 user nova-compute[74903]:     <nova:memory>512</nova:memory>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:disk>1</nova:disk>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:swap>0</nova:swap>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:flavor>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:user uuid="5df2a7857d124d31b806d45b3129a884">tempest-TaggedAttachmentsTest-1365070387-project-member</nova:user>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:project uuid="c17d9a876d7e4959b411546efc318ae5">tempest-TaggedAttachmentsTest-1365070387</nova:project>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:owner>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:38 user nova-compute[74903]:   <nova:ports>
Nov 06 06:04:38 user nova-compute[74903]:     <nova:port uuid="be91300f-ea64-409f-a8c0-597d0d8fdf58">
Nov 06 06:04:38 user nova-compute[74903]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:04:38 user nova-compute[74903]:     </nova:port>
Nov 06 06:04:38 user nova-compute[74903]:   </nova:ports>
Nov 06 06:04:38 user nova-compute[74903]: </nova:instance>
Nov 06 06:04:38 user nova-compute[74903]:  {{(pid=74903) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.network.neutron [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [{"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Releasing lock "refresh_cache-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-91408d29-31c7-4cd2-bfcd-9ceedbb3bd16 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "interface-5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-75369dce-72cd-4324-8a18-7d77e444964b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.594s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] No waiting events found dispatching network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:39 user nova-compute[74903]: WARNING nova.compute.manager [req-430fda56-1e56-476f-aab3-e18608fb0572 req-9ab1dd0d-8785-4606-9ed1-8287412a1381 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received unexpected event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 for instance with vm_state building and task_state spawning.
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:04:39 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Instance spawned successfully.
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:39 user nova-compute[74903]: INFO nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 06 06:04:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:04:39 user nova-compute[74903]: INFO nova.compute.manager [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Took 6.87 seconds to build instance.
Nov 06 06:04:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7cae6589-e4ed-4241-a6d9-9c60ad0d0bc4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.962s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:43 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dee138d4-059b-489d-8122-cbb4b2c2112e is timed out.
Nov 06 06:04:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully detached device vdb from instance dee138d4-059b-489d-8122-cbb4b2c2112e from the live domain config.
Nov 06 06:04:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXdTPGYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:43 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e941b11-3700-4165-b3e2-abd91016256b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:04:43 user nova-compute[74903]: No targets found.
Nov 06 06:04:43 user nova-compute[74903]: iSNS:
Nov 06 06:04:43 user nova-compute[74903]: No targets found.
Nov 06 06:04:43 user nova-compute[74903]: STATIC:
Nov 06 06:04:43 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:04:43 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:43 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:43 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:04:43 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:43 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:43 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3
Nov 06 06:04:43 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:43 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:43 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:04:43 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:43 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:43 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53
Nov 06 06:04:43 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:43 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:43 user nova-compute[74903]: FIRMWARE:
Nov 06 06:04:43 user nova-compute[74903]: No targets found.
Nov 06 06:04:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:04:43 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:04:43 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f51a6-cdff-4333-a5d6-428205a89218]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8134ae28-34a9-4376-b53b-812fdb6565de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:43 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085ff6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[241295a9-a671-48d4-b2a5-10f7691b238d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[293560b9-05b8-4036-8e0d-27032781fd6e]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087ca54-965f-41dc-a42f-f5ba9b002bc6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3314b-c185-429b-bc0b-ddced24b41e7]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f02892-6cb3-4c0f-9b40-14fb2214354d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c28c45-4b6a-4e59-a590-56d00201af42]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260]
Nov 06 06:04:43 user nova-compute[74903]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1189533d-fb93-4a26-9488-3427e27f4b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb3f6f-a1aa-4cba-b27e-d5567a6b6c6f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== disconnect_volume: return (422ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:04:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'flavor' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5d9cafe0-8ff1-4e31-832f-40e9b96fc40f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.274s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing instance network info cache due to event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG nova.network.neutron [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:04:48 user nova-compute[74903]: INFO nova.compute.claims [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Claim successful on node user
Nov 06 06:04:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updated VIF entry in instance network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4174b46d-4c22-4722-aa5d-5c62b8a18872 req-bae7ab2f-02b4-40eb-a31e-88303f107de8 service nova] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:04:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:04:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Creating image(s)
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "/opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "/opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "/opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.policy [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a304c402d6c346ff80715df1d2b10107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea5f20779e746cdae6c855ac1b044a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.302s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk 1073741824" returned: 0 in 0.060s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-changed-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Refreshing instance network info cache due to event network-changed-bd470b96-807a-4d77-8af1-362676fa3552. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Refreshing network info cache for port bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:04:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Cannot resize image /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Ensure instance console log exists: /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Successfully created port: 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.network.neutron [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updated VIF entry in instance network info cache for port bd470b96-807a-4d77-8af1-362676fa3552. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG nova.network.neutron [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f92f3ffa-b170-4a90-91ec-073193f7c87c req-0652ae48-363e-410c-865c-e65d4bf20c31 service nova] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Successfully updated port: 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquired lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-changed-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Refreshing instance network info cache due to event network-changed-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] Acquiring lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:04:51 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8239a418-b65a-4d4f-95dd-efe0e836403a is timed out.
Nov 06 06:04:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Successfully detached device vdb from instance 8239a418-b65a-4d4f-95dd-efe0e836403a from the live domain config.
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJrISxCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:04:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5eda0a-9371-488a-90de-dff59ae9217e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:04:51 user nova-compute[74903]: No targets found.
Nov 06 06:04:51 user nova-compute[74903]: iSNS:
Nov 06 06:04:51 user nova-compute[74903]: No targets found.
Nov 06 06:04:51 user nova-compute[74903]: STATIC:
Nov 06 06:04:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:04:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:04:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3
Nov 06 06:04:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:04:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:04:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:04:51 user nova-compute[74903]: FIRMWARE:
Nov 06 06:04:51 user nova-compute[74903]: No targets found.
Nov 06 06:04:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:04:51 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:04:51 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0052181-cf1f-4bb5-9f26-cc80f760235b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7451334-55cc-421f-80d0-7aab1c2fa82e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:04:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:04:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28725b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3'): ({'sde'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Removing single pathed devices sde {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ff909-eacf-4d03-95d4-0eb8f07015f9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6af7bb-e786-493a-9090-7b6a973e4b69]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Flushing IO for device /dev/sde {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f111e9-e84e-4369-a882-8aea20401da4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a2752f-3c8b-4c4e-a765-3b4a1b7881f2]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updating instance_info_cache with network_info: [{"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbfd430-cb2b-48be-b0c0-c9a7222e8bf6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Releasing lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Instance network_info: |[{"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] Acquired lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.neutron [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Refreshing network info cache for port 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Start _get_guest_xml network_info=[{"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:04:51 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:51 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[813a4179-9452-4c56-8665-6e33e23687ec]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260]
Nov 06 06:04:51 user nova-compute[74903]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3, portal: 172.16.0.220,3260] successful.
Nov 06 06:04:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-506778373',display_name='tempest-VolumesSnapshotTestJSON-instance-506778373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-506778373',id=25,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1XYbWC6nnOoE0BHmlH7RnO5CZZZKhmT9FxwZBfl1D5IBEjcgP3zy54fixbK5suFRLmlcx9AYly8hcN3O2zZKja6XBnMOSXdBZhi3WtHYO999GlPNKdWSuZiOEidMwy9w==',key_name='tempest-keypair-471709284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-1ls7610l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=673648d8-b84a-43ff-8e2b-e52702a198be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'pci_devices' on Instance uuid 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d372750-1b30-4c60-9328-ab8524db25f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[82019b83-573a-4828-98e5-dd0fe992c8ce]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] <== disconnect_volume: return (366ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:04:51 user nova-compute[74903]:   <uuid>673648d8-b84a-43ff-8e2b-e52702a198be</uuid>
Nov 06 06:04:51 user nova-compute[74903]:   <name>instance-00000019</name>
Nov 06 06:04:51 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:04:51 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:04:51 user nova-compute[74903]:   <metadata>
Nov 06 06:04:51 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:04:51 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-506778373</nova:name>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:04:51</nova:creationTime>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:04:51 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:04:51 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:owner>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:user uuid="a304c402d6c346ff80715df1d2b10107">tempest-VolumesSnapshotTestJSON-453337636-project-member</nova:user>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:project uuid="8ea5f20779e746cdae6c855ac1b044a4">tempest-VolumesSnapshotTestJSON-453337636</nova:project>
Nov 06 06:04:51 user nova-compute[74903]:       </nova:owner>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:04:51 user nova-compute[74903]:       <nova:ports>
Nov 06 06:04:51 user nova-compute[74903]:         <nova:port uuid="3229e50e-e2b1-44c3-b1f1-baa9227ffb2a">
Nov 06 06:04:51 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:04:51 user nova-compute[74903]:         </nova:port>
Nov 06 06:04:51 user nova-compute[74903]:       </nova:ports>
Nov 06 06:04:51 user nova-compute[74903]:     </nova:instance>
Nov 06 06:04:51 user nova-compute[74903]:   </metadata>
Nov 06 06:04:51 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:04:51 user nova-compute[74903]:     <system>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="serial">673648d8-b84a-43ff-8e2b-e52702a198be</entry>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="uuid">673648d8-b84a-43ff-8e2b-e52702a198be</entry>
Nov 06 06:04:51 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:04:51 user nova-compute[74903]:     </system>
Nov 06 06:04:51 user nova-compute[74903]:   </sysinfo>
Nov 06 06:04:51 user nova-compute[74903]:   <os>
Nov 06 06:04:51 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:04:51 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:04:51 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:04:51 user nova-compute[74903]:   </os>
Nov 06 06:04:51 user nova-compute[74903]:   <features>
Nov 06 06:04:51 user nova-compute[74903]:     <acpi/>
Nov 06 06:04:51 user nova-compute[74903]:     <apic/>
Nov 06 06:04:51 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:04:51 user nova-compute[74903]:   </features>
Nov 06 06:04:51 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:04:51 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:04:51 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:04:51 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:04:51 user nova-compute[74903]:   </clock>
Nov 06 06:04:51 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:04:51 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:04:51 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:04:51 user nova-compute[74903]:   </cpu>
Nov 06 06:04:51 user nova-compute[74903]:   <devices>
Nov 06 06:04:51 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:04:51 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:04:51 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk"/>
Nov 06 06:04:51 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:04:51 user nova-compute[74903]:     </disk>
Nov 06 06:04:51 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:04:51 user nova-compute[74903]:       <mac address="fa:16:3e:ea:7e:f6"/>
Nov 06 06:04:51 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:51 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:04:51 user nova-compute[74903]:       <target dev="tap3229e50e-e2"/>
Nov 06 06:04:51 user nova-compute[74903]:     </interface>
Nov 06 06:04:51 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:04:51 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/console.log" append="off"/>
Nov 06 06:04:51 user nova-compute[74903]:     </serial>
Nov 06 06:04:51 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:04:51 user nova-compute[74903]:     <video>
Nov 06 06:04:51 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:04:51 user nova-compute[74903]:     </video>
Nov 06 06:04:51 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:04:51 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:04:51 user nova-compute[74903]:     </rng>
Nov 06 06:04:51 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:04:51 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:04:51 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:04:51 user nova-compute[74903]:     </memballoon>
Nov 06 06:04:51 user nova-compute[74903]:   </devices>
Nov 06 06:04:51 user nova-compute[74903]: </domain>
Nov 06 06:04:51 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-506778373',display_name='tempest-VolumesSnapshotTestJSON-instance-506778373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-506778373',id=25,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1XYbWC6nnOoE0BHmlH7RnO5CZZZKhmT9FxwZBfl1D5IBEjcgP3zy54fixbK5suFRLmlcx9AYly8hcN3O2zZKja6XBnMOSXdBZhi3WtHYO999GlPNKdWSuZiOEidMwy9w==',key_name='tempest-keypair-471709284',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-1ls7610l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:04:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=673648d8-b84a-43ff-8e2b-e52702a198be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG os_vif [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc997757-a842-5de3-a35d-dc8fe14ace8e', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3229e50e-e2, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3229e50e-e2, col_values=(('qos', UUID('cc1f3f4f-9501-49b9-be04-fbfe329a2ef7')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3229e50e-e2, col_values=(('external_ids', {'iface-id': '3229e50e-e2b1-44c3-b1f1-baa9227ffb2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:7e:f6', 'vm-uuid': '673648d8-b84a-43ff-8e2b-e52702a198be'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:51 user nova-compute[74903]: INFO os_vif [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2')
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:04:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No VIF found with MAC fa:16:3e:ea:7e:f6, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:04:52 user nova-compute[74903]: DEBUG nova.network.neutron [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updated VIF entry in instance network info cache for port 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:04:52 user nova-compute[74903]: DEBUG nova.network.neutron [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updating instance_info_cache with network_info: [{"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ce3895b8-a1b5-4c10-a835-5105d483f51d req-630581b5-5d7b-4294-9f46-97f442849b59 service nova] Releasing lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] No waiting events found dispatching network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:53 user nova-compute[74903]: WARNING nova.compute.manager [req-6ff36468-5a3e-46b6-93e9-a5d48a6e7378 req-c0e0fb8d-7665-44f7-8a42-14cb77ece302 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received unexpected event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a for instance with vm_state building and task_state spawning.
Nov 06 06:04:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:55 user nova-compute[74903]: INFO nova.compute.manager [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Shelving
Nov 06 06:04:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] No waiting events found dispatching network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:55 user nova-compute[74903]: WARNING nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received unexpected event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a for instance with vm_state building and task_state spawning.
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:55 user nova-compute[74903]: WARNING nova.compute.manager [req-4f2c558a-59a9-4ea0-935f-6b0ee280ad7f req-eee0fb4b-f3ae-451b-ac65-23ce986045ab service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state active and task_state shelving.
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:04:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Instance spawned successfully.
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:04:56 user nova-compute[74903]: INFO nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 06 06:04:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:56 user nova-compute[74903]: INFO nova.compute.manager [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Took 8.08 seconds to build instance.
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-252af6b1-e354-4aff-92c0-d9e939ada2f6 tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.188s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:56 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance destroyed successfully.
Nov 06 06:04:56 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Beginning cold snapshot process
Nov 06 06:04:56 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'flavor' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk /opt/stack/data/nova/instances/snapshots/tmpz0wuy2uy/5849ab38969843d0b763db0aea4dcbea {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad3d6e71-f2b0-4cc3-9580-1649b97d756c tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.606s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:56 user nova-compute[74903]: INFO nova.compute.manager [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Terminating instance
Nov 06 06:04:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk /opt/stack/data/nova/instances/snapshots/tmpz0wuy2uy/5849ab38969843d0b763db0aea4dcbea" returned: 0 in 0.776s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:04:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Snapshot extracted, beginning image upload
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Instance destroyed successfully.
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lazy-loading 'resources' on Instance uuid 62b2e140-f082-47b9-8347-25ad5123e39e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2094575578',display_name='tempest-ServersNegativeTestJSON-server-2094575578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2094575578',id=2,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30951113bf204ff48659ef6726d35d25',ramdisk_id='',reservation_id='r-giw65wo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-668548580',owner_user_name='tempest-ServersNegativeTestJSON-668548580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:55:29Z,user_data=None,user_id='ccd7e52315424aaea03ff0c931cbeec8',uuid=62b2e140-f082-47b9-8347-25ad5123e39e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converting VIF {"id": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "address": "fa:16:3e:ac:bd:63", "network": {"id": "12cd346e-84fe-4b52-91ea-4d6954b6a60f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-667986922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30951113bf204ff48659ef6726d35d25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3b0d19b-36", "ovs_interfaceid": "c3b0d19b-3612-4f71-8bd9-9fee1e553ad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG os_vif [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3b0d19b-36, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9841d438-5574-4cf0-9d98-f98e87be0618) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:04:57 user nova-compute[74903]: INFO os_vif [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:bd:63,bridge_name='br-int',has_traffic_filtering=True,id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7,network=Network(12cd346e-84fe-4b52-91ea-4d6954b6a60f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3b0d19b-36')
Nov 06 06:04:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Deleting instance files /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e_del
Nov 06 06:04:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Deletion of /opt/stack/data/nova/instances/62b2e140-f082-47b9-8347-25ad5123e39e_del complete
Nov 06 06:04:57 user nova-compute[74903]: INFO nova.compute.manager [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:57 user nova-compute[74903]: WARNING nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state active and task_state shelving_image_uploading.
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-unplugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] No waiting events found dispatching network-vif-unplugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-unplugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Acquiring lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] Lock "62b2e140-f082-47b9-8347-25ad5123e39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] No waiting events found dispatching network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:04:57 user nova-compute[74903]: WARNING nova.compute.manager [req-460c340e-a5a9-46a3-a0d6-523f226802db req-331ae9de-b4a3-4dec-8fb8-8899a3a55537 service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received unexpected event network-vif-plugged-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 for instance with vm_state active and task_state deleting.
Nov 06 06:04:58 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:58 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Took 0.62 seconds to deallocate network for instance.
Nov 06 06:04:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-f0ea55a4-2409-4d3c-a4a6-a255e6503059 req-419083d8-ab70-4534-bebf-6c02619c96ba service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Received event network-vif-deleted-c3b0d19b-3612-4f71-8bd9-9fee1e553ad7 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:04:58 user nova-compute[74903]: INFO nova.compute.manager [req-f0ea55a4-2409-4d3c-a4a6-a255e6503059 req-419083d8-ab70-4534-bebf-6c02619c96ba service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Neutron deleted interface c3b0d19b-3612-4f71-8bd9-9fee1e553ad7; detaching it from the instance and deleting it from the info cache
Nov 06 06:04:58 user nova-compute[74903]: DEBUG nova.network.neutron [req-f0ea55a4-2409-4d3c-a4a6-a255e6503059 req-419083d8-ab70-4534-bebf-6c02619c96ba service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:04:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-f0ea55a4-2409-4d3c-a4a6-a255e6503059 req-419083d8-ab70-4534-bebf-6c02619c96ba service nova] [instance: 62b2e140-f082-47b9-8347-25ad5123e39e] Detach interface failed, port_id=c3b0d19b-3612-4f71-8bd9-9fee1e553ad7, reason: Instance 62b2e140-f082-47b9-8347-25ad5123e39e could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:04:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:04:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:04:59 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:04:59 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:04:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:04:59 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Deleted allocations for instance 62b2e140-f082-47b9-8347-25ad5123e39e
Nov 06 06:04:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1f05b262-6104-4113-adc9-bf6f2af6dd86 tempest-ServersNegativeTestJSON-668548580 tempest-ServersNegativeTestJSON-668548580-project-member] Lock "62b2e140-f082-47b9-8347-25ad5123e39e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.612s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:00 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Snapshot image upload complete
Nov 06 06:05:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:05:00 user nova-compute[74903]: INFO nova.compute.manager [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Shelve offloading
Nov 06 06:05:00 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance destroyed successfully.
Nov 06 06:05:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:05:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance destroyed successfully.
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'resources' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRiYW4ukChs+JZOBpsK9ynUaGRNjeWYCJO6a2zz4ZoAtjjYxe/YVN1ryCoIZ5nJJ953kmtJ2Lc82AxpuoEvEcoHLeOOEJXP9F7+HG6Cm/2afiYjncfeAGjopBOBB+JcGA==',key_name='tempest-keypair-610860067',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:05:00.553216',shelved_host='user',shelved_image_id='b879b71d-7b33-41ee-836c-d52cdf05a1c5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG os_vif [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.compute.manager [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing instance network info cache due to event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.network.neutron [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d84ce5-1c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d18fe74-7b32-420e-984c-85a9c31d5547) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:01 user nova-compute[74903]: INFO os_vif [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c')
Nov 06 06:05:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Deleting instance files /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c_del
Nov 06 06:05:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Deletion of /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c_del complete
Nov 06 06:05:01 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Deleted allocations for instance 6a685cae-989a-473d-80b9-ded3974de38c
Nov 06 06:05:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:01 user nova-compute[74903]: DEBUG nova.objects.base [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<6a685cae-989a-473d-80b9-ded3974de38c> lazy-loaded attributes: resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG nova.network.neutron [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updated VIF entry in instance network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG nova.network.neutron [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-97cb4f98-ed62-4f59-af3a-c047c356efaa req-0f261230-ea76-4271-ad01-cc606494277d service nova] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ce4eac83-597d-4500-adb8-b0b9273610b7 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.092s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:08 user nova-compute[74903]: INFO nova.compute.manager [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Terminating instance
Nov 06 06:05:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-unplugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-unplugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-8b0c3591-ebe4-40c1-b2cb-f0e03525c8cf req-84425c7c-acf9-49b9-a4ca-9bb34b4f3c8e service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-unplugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:05:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Instance destroyed successfully.
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lazy-loading 'resources' on Instance uuid 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T06:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1984165036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1984165036',id=18,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3BXD0uUC7rcwOIDAR26rdaaYvhA+MkocQqsBmGDpJYVsDFrh93Gvpof0daTDVKxKOxrNv7O2oB7dy1VIzib2ARYhaD9IPrzdjBHq5F54XnWBr4z9W8dURuR2rRx1BNNA==',key_name='tempest-keypair-838290740',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c17d9a876d7e4959b411546efc318ae5',ramdisk_id='',reservation_id='r-jc757rva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1365070387',owner_user_name='tempest-TaggedAttachmentsTest-1365070387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5df2a7857d124d31b806d45b3129a884',uuid=5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converting VIF {"id": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "address": "fa:16:3e:1b:a5:de", "network": {"id": "b78b4eee-066c-4504-ae46-fd7fce89be95", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-371320210-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c17d9a876d7e4959b411546efc318ae5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe91300f-ea", "ovs_interfaceid": "be91300f-ea64-409f-a8c0-597d0d8fdf58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG os_vif [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe91300f-ea, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9230fc0-cc6c-4faf-a681-6c064196241d) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:09 user nova-compute[74903]: INFO os_vif [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:a5:de,bridge_name='br-int',has_traffic_filtering=True,id=be91300f-ea64-409f-a8c0-597d0d8fdf58,network=Network(b78b4eee-066c-4504-ae46-fd7fce89be95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe91300f-ea')
Nov 06 06:05:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Deleting instance files /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db_del
Nov 06 06:05:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Deletion of /opt/stack/data/nova/instances/5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db_del complete
Nov 06 06:05:09 user nova-compute[74903]: INFO nova.compute.manager [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:05:09 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:05:09 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:10 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Took 0.84 seconds to deallocate network for instance.
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b28aa92b-e8e1-40e6-a711-1a84b16a2ae5 req-ec522d17-1b60-41c2-acc0-2a405969b71a service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-deleted-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:10 user nova-compute[74903]: INFO nova.compute.manager [req-b28aa92b-e8e1-40e6-a711-1a84b16a2ae5 req-ec522d17-1b60-41c2-acc0-2a405969b71a service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Neutron deleted interface be91300f-ea64-409f-a8c0-597d0d8fdf58; detaching it from the instance and deleting it from the info cache
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.network.neutron [req-b28aa92b-e8e1-40e6-a711-1a84b16a2ae5 req-ec522d17-1b60-41c2-acc0-2a405969b71a service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b28aa92b-e8e1-40e6-a711-1a84b16a2ae5 req-ec522d17-1b60-41c2-acc0-2a405969b71a service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Detach interface failed, port_id=be91300f-ea64-409f-a8c0-597d0d8fdf58, reason: Instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:10 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Deleted allocations for instance 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7df3b8ed-7f17-4a5d-9a39-16764c1469e1 tempest-TaggedAttachmentsTest-1365070387 tempest-TaggedAttachmentsTest-1365070387-project-member] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.295s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] Acquiring lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] Lock "5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] No waiting events found dispatching network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:10 user nova-compute[74903]: WARNING nova.compute.manager [req-9a81db01-29e3-47d1-91ab-ce49c3556498 req-9b596449-7495-421d-a2b6-6a027e0d1cc0 service nova] [instance: 5f2e3cc6-5ed9-4a04-9d63-2ae1603c43db] Received unexpected event network-vif-plugged-be91300f-ea64-409f-a8c0-597d0d8fdf58 for instance with vm_state deleted and task_state None.
Nov 06 06:05:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:11 user nova-compute[74903]: INFO nova.compute.manager [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Terminating instance
Nov 06 06:05:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.utils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29cfc31-b9bc-4d10-9c12-b449610e3a05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d403628-368f-4ebd-a4b9-d7fbfbf44fea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3a56cf-c120-48f4-8193-851bce5dce63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d360b-8237-4fe7-bfdb-5856bc8115f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-e09e02ee-fc18-4988-8c28-b81a3672aa65 req-2a886288-ced6-4296-88c9-7e3aec76f598 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-unplugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:11 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:05:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee65c9a-5366-4921-8986-cc854786034c]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG os_brick.utils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:11 user nova-compute[74903]: INFO nova.compute.manager [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Swapping volume 6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 for 6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:05:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Instance destroyed successfully.
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'resources' on Instance uuid dee138d4-059b-489d-8122-cbb4b2c2112e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T05:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-111030931',display_name='tempest-ServerActionsTestOtherA-server-580424261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-111030931',id=15,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpEt8Fef5fqq6Rtv2U6uEZUD3R7GHtuLp1YR9nnAOXjwCEryK2JB4UbvM4+Ovt3drX76V4ZPVNDxHkyk724PQvSrvbiNeR4aWCTEP7XkDmfNWjRHjwMY/yNMOuYUZLopg==',key_name='tempest-keypair-633759824',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-0d006yuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=dee138d4-059b-489d-8122-cbb4b2c2112e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "address": "fa:16:3e:2f:b5:21", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9033c9b3-0d", "ovs_interfaceid": "9033c9b3-0dba-4b46-bea3-5a3b0bf02649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG os_vif [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9033c9b3-0d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51c18e46-f64f-461e-b1a5-3b788aed81b4) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:12 user nova-compute[74903]: INFO os_vif [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b5:21,bridge_name='br-int',has_traffic_filtering=True,id=9033c9b3-0dba-4b46-bea3-5a3b0bf02649,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9033c9b3-0d')
Nov 06 06:05:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Deleting instance files /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e_del
Nov 06 06:05:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Deletion of /opt/stack/data/nova/instances/dee138d4-059b-489d-8122-cbb4b2c2112e_del complete
Nov 06 06:05:12 user nova-compute[74903]: INFO nova.compute.manager [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:05:12 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:12 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Took 0.79 seconds to deallocate network for instance.
Nov 06 06:05:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-75be75b0-753d-44cf-ae7b-8198962cb0b8 req-23c96a1b-fc3e-4d0f-a0e4-9d9085298127 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-deleted-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.215s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:05:13 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Deleted allocations for instance dee138d4-059b-489d-8122-cbb4b2c2112e
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e6db9775-a440-4eb2-9c23-54dba83444b4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] Acquiring lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] Lock "dee138d4-059b-489d-8122-cbb4b2c2112e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] No waiting events found dispatching network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:13 user nova-compute[74903]: WARNING nova.compute.manager [req-152263e6-9e83-4981-a593-34264f3591f7 req-d3caf504-7f43-488d-a7aa-809ad2093526 service nova] [instance: dee138d4-059b-489d-8122-cbb4b2c2112e] Received unexpected event network-vif-plugged-9033c9b3-0dba-4b46-bea3-5a3b0bf02649 for instance with vm_state deleted and task_state None.
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:05:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=6884MB free_disk=25.237869262695312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 510bcb77-b1fc-4009-a17e-8673dc9b77df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 673648d8-b84a-43ff-8e2b-e52702a198be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:05:18 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:05:19 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:19 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:19 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:05:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:05:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG nova.objects.instance [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'flavor' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:27 user nova-compute[74903]: INFO nova.compute.manager [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Attaching volume fb9816ac-0170-4a83-b294-44df6639ba7b to /dev/vdb
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.utils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8866c416-1846-4ed5-b847-f8c2a2d98f11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2993828-5b2b-4b98-ac57-ddaeb542faf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c54b6-324f-458d-b891-95f7982a2380]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b68fd-0161-46f8-9e75-64665cc03594]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:27 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:05:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa0a1e-df1b-4bd7-bbae-3939c40ae037]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG os_brick.utils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:27 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating existing volume attachment record: 04bfb24f-8c54-481f-8f26-056c89f7cf4b {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:05:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6b060355-7015-4a5f-a3a4-4a870eab766e', 'serial': '6b060355-7015-4a5f-a3a4-4a870eab766e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3'}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'serial'} {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:33 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:05:33 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:05:33 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2374988-c1f0-47d2-8102-517c8db4d412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:05:33 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e79808c-18d9-4948-b88a-e8d0876d3b58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e] added
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e547a99-185d-4a18-a91f-531894cb568a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[287bf743-cde4-4eda-bb3b-db47c401c51c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIBzePWp {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIBzePWp" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56953670-4f15-4e2f-8da3-7421dae7b2b0]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIBzePWp'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a97bb-3e74-4547-82a2-ba4f678b2266]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff06189a-f37c-4091-9e78-7179a0ec21e8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7d122-19d4-4173-8877-43f160227b5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]
Nov 06 06:05:33 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d997cc-6156-4f11-b858-829f09c071d4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[879120be-3333-4fc9-99b8-856826921780]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc80fe1-e785-454a-98ae-5433b298d646]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23666616533316363', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666616533316363', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:05:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lazy-loading 'flavor' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 4194304 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 87031808 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 208666624 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 332398592 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 477102080 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 770703360 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 927989760 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 1072693248 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing instance network info cache due to event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG nova.network.neutron [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:05:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eAHKoWDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '6a4b6937-bec6-4a46-a5b9-fe796e0a14d3'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:40 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1dd7b7-616f-47ce-a803-ec696f22295f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:05:40 user nova-compute[74903]: No targets found.
Nov 06 06:05:40 user nova-compute[74903]: iSNS:
Nov 06 06:05:40 user nova-compute[74903]: No targets found.
Nov 06 06:05:40 user nova-compute[74903]: STATIC:
Nov 06 06:05:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:05:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:05:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:05:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:40 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3
Nov 06 06:05:40 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:40 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:40 user nova-compute[74903]: FIRMWARE:
Nov 06 06:05:40 user nova-compute[74903]: No targets found.
Nov 06 06:05:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:05:40 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:05:40 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4761dc5f-3c92-49d0-bd59-b7ff1d91f425]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a49f01-90ac-4b74-a547-5d3ccf88c9df]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:40 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa086bf760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3'): ({'sdg'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Removing single pathed devices sdg {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updated VIF entry in instance network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3151c35-e36f-48a1-9b97-0cf1c6139e1f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-076eb995-5f01-4c1c-9db1-77324134d610 req-8a6c7f8a-19bd-434c-aa63-a2ce2b725cb0 service nova] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c6888-9d0f-4f82-8a7c-19382b6842b4]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Flushing IO for device /dev/sdg {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2b454-3100-4ffa-a8c0-e3738bb4a9ab]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:40 user nova-compute[74903]: INFO nova.compute.manager [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Shelve offloading
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8cc7ad-6c5a-4638-acc9-319035c06774]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2781e9fb-0279-4d3a-9f82-c63a7c1d308c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc0dce-17a6-4409-88dd-e976dd3379d9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260]
Nov 06 06:05:40 user nova-compute[74903]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3, portal: 172.16.0.220,3260] successful.
Nov 06 06:05:40 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfda4f2d-4ca9-4432-862d-577f1408e152]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] <== disconnect_volume: return (345ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b781713b-1c98-4674-901c-a834bf648636', 'attached_at': '', 'detached_at': '', 'volume_id': '6b060355-7015-4a5f-a3a4-4a870eab766e', 'serial'} {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: removing Cinder connection for volume 6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 {{(pid=74903) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:40 user nova-compute[74903]: WARNING nova.compute.manager [req-f4d6db4b-96d2-488d-91fc-e3f9ff738237 req-2daa8794-21fe-4577-af8f-bef6533b8101 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state active and task_state shelving.
Nov 06 06:05:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance destroyed successfully.
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:05:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] [instance: b781713b-1c98-4674-901c-a834bf648636] swap_volume: Updating volume 6a4b6937-bec6-4a46-a5b9-fe796e0a14d3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UIBzePWp", "auth_password": "kUBMqejzvuZ4NP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "6b060355-7015-4a5f-a3a4-4a870eab766e"}, "status": "reserved", "instance": "b781713b-1c98-4674-901c-a834bf648636", "attached_at": "", "detached_at": "", "volume_id": "6b060355-7015-4a5f-a3a4-4a870eab766e", "serial": "6b060355-7015-4a5f-a3a4-4a870eab766e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6b060355-7015-4a5f-a3a4-4a870eab766e', 'no_device': None, 'attachment_id': 'c64e0885-2880-4f69-887d-333807efe4e9'} {{(pid=74903) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 06:05:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8a10c0cd-b86f-4469-8bdf-aa94dd79def8 tempest-TestVolumeSwap-1844356574 tempest-TestVolumeSwap-1844356574-project-admin] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 30.094s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.volume.cinder [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Update attachment failed for attachment 04bfb24f-8c54-481f-8f26-056c89f7cf4b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Failed to attach fb9816ac-0170-4a83-b294-44df6639ba7b at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Traceback (most recent call last):
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     self._do_attach(context, instance, volume, volume_api,
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     self._volume_attach(context, volume, connector, instance,
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     connection_info = volume_api.attachment_update(
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     res = method(self, ctx, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     return method.func(obj, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     resp = self._update('/attachments/%s' % id, body)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     return self.request(url, method, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a]     raise exceptions.from_response(resp, body)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6)
Nov 06 06:05:41 user nova-compute[74903]: ERROR nova.compute.manager [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] 
Nov 06 06:05:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.503s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server [None req-b85a21b2-53dc-463d-a528-e3e1757c0056 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e96f12f5-cc4f-4c18-843b-dd8a43a33fb6)
Nov 06 06:05:41 user nova-compute[74903]: ERROR oslo_messaging.rpc.server 
Nov 06 06:05:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance destroyed successfully.
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'resources' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpweiMHBr6jQ+m9OIYh7A/g+dNeJ/4KwTlhdSahFJAu3qKEWlBKpnoUpoGy1+sEGUfR/oA1LSExC4cUGfqlVDNGqMM769vNAXCBv/ZqxlXj+kYUtmAflt1VH5R0oPJU8A==',key_name='tempest-TestShelveInstance-2063912077',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:04:23Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_vif [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb35081d0-53, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec578268-360b-4f64-b0cd-840286afdf21) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:42 user nova-compute[74903]: INFO os_vif [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53')
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12f674-5e66-4087-ab33-4ad538fe26bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:05:42 user nova-compute[74903]: No targets found.
Nov 06 06:05:42 user nova-compute[74903]: iSNS:
Nov 06 06:05:42 user nova-compute[74903]: No targets found.
Nov 06 06:05:42 user nova-compute[74903]: STATIC:
Nov 06 06:05:42 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:05:42 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:42 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:42 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:05:42 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:42 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:42 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:05:42 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:05:42 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:05:42 user nova-compute[74903]: FIRMWARE:
Nov 06 06:05:42 user nova-compute[74903]: No targets found.
Nov 06 06:05:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:05:42 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:05:42 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[821cb371-26d1-46c1-89b6-b27fcf43ee8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:42 user nova-compute[74903]: WARNING nova.compute.manager [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state active and task_state shelving.
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing instance network info cache due to event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.network.neutron [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c0ddb-5d4c-4a35-9732-de7138cf2dd4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:42 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:05:42 user nova-compute[74903]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:05:42 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:05:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa086bdc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2df63-b3cf-4ed6-85ac-17b80526aff7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[335346a3-5157-4c0e-b501-61c78f868ea9]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c961799-d657-4e87-a5a6-3ec5ec765682]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a3a47-e934-488b-9a63-838714f68d00]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad71675-ee49-4c57-a281-b22a71ac4e7d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[133ac6e8-d196-4e84-9459-1e8f6a69c9e4]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]
Nov 06 06:05:42 user nova-compute[74903]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.
Nov 06 06:05:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6d8a39-e6e7-4106-b45c-aba26e207525]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== disconnect_volume: return (375ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:05:42 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deleting instance files /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50_del
Nov 06 06:05:42 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deletion of /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50_del complete
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.compute.manager [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Terminating instance
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.network.neutron [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updated VIF entry in instance network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.network.neutron [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": null, "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb35081d0-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-875b1c5a-b49a-4fb0-8e3a-5e8b860b75be req-d4f32426-9a97-4d31-a439-76973c72a502 service nova] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-unplugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] No waiting events found dispatching network-vif-unplugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-054ff6d1-e6b2-4e98-8141-da774b874a37 req-0e4688d1-3d54-4f1e-9f7b-131b8aa245e8 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-unplugged-106503e0-5cc4-46f7-bcd2-d66a078793cf for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.compute.manager [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Detaching volume 6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.virt.block_device [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Attempting to driver detach volume 6b060355-7015-4a5f-a3a4-4a870eab766e from mountpoint /dev/vdb
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Attempting to detach device vdb from instance b781713b-1c98-4674-901c-a834bf648636 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:05:43 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:05:43 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:05:43 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:05:43 user nova-compute[74903]:   <serial>6b060355-7015-4a5f-a3a4-4a870eab766e</serial>
Nov 06 06:05:43 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:05:43 user nova-compute[74903]: </disk>
Nov 06 06:05:43 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Successfully detached device vdb from instance b781713b-1c98-4674-901c-a834bf648636 from the persistent domain config.
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b781713b-1c98-4674-901c-a834bf648636 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:05:43 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:05:43 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:05:43 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:05:43 user nova-compute[74903]:   <serial>6b060355-7015-4a5f-a3a4-4a870eab766e</serial>
Nov 06 06:05:43 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:05:43 user nova-compute[74903]: </disk>
Nov 06 06:05:43 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Instance destroyed successfully.
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lazy-loading 'resources' on Instance uuid 510bcb77-b1fc-4009-a17e-8673dc9b77df {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1410095098',display_name='tempest-VolumesActionsTest-instance-1410095098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1410095098',id=22,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-8cgm3t7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:03:59Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=510bcb77-b1fc-4009-a17e-8673dc9b77df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "address": "fa:16:3e:1b:70:e4", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap106503e0-5c", "ovs_interfaceid": "106503e0-5cc4-46f7-bcd2-d66a078793cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG os_vif [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap106503e0-5c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bc2e86f-3b09-4ff6-85c5-28625db3fc00) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:05:43 user nova-compute[74903]: INFO os_vif [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:70:e4,bridge_name='br-int',has_traffic_filtering=True,id=106503e0-5cc4-46f7-bcd2-d66a078793cf,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap106503e0-5c')
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Deleting instance files /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df_del
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Deletion of /opt/stack/data/nova/instances/510bcb77-b1fc-4009-a17e-8673dc9b77df_del complete
Nov 06 06:05:43 user nova-compute[74903]: INFO nova.compute.manager [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 06:05:43 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:05:43 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:05:44 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Deleted allocations for instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'numa_topology' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.objects.base [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Object Instance<c4c9a4d3-6553-48f6-85b1-00d9c905cc50> lazy-loaded attributes: resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:44 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Took 0.49 seconds to deallocate network for instance.
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-e6cbbe0d-9aa2-4ce9-8a64-e2b51bf72022 req-a4311c30-84ba-445b-957f-1c7efa9d62e2 service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-deleted-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.212s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9b75fcc2-1d9d-4457-be52-1a8e01c065f9 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.589s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:45 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Deleted allocations for instance 510bcb77-b1fc-4009-a17e-8673dc9b77df
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2d791599-8a60-4627-a035-ed2db6f5b984 tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Acquiring lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Lock "510bcb77-b1fc-4009-a17e-8673dc9b77df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] No waiting events found dispatching network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:05:45 user nova-compute[74903]: WARNING nova.compute.manager [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 510bcb77-b1fc-4009-a17e-8673dc9b77df] Received unexpected event network-vif-plugged-106503e0-5cc4-46f7-bcd2-d66a078793cf for instance with vm_state deleted and task_state None.
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing instance network info cache due to event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.network.neutron [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'flavor' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:45 user nova-compute[74903]: INFO nova.compute.manager [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Attaching volume fd82875d-6c9d-4197-a442-ba11f828cdb0 to /dev/vdb
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.utils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56a431e-5051-4e00-8ffe-ef145eea17d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ebfc9f-68cd-4b77-b840-902f91687db7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a768abdd-19d3-4e6c-bfc7-c389248ba16b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c73c86-8e5c-4d02-b86d-67d9fa6936ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:45 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:05:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bec157-e9dd-4d5e-bdd1-c11648002439]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG os_brick.utils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:45 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating existing volume attachment record: 137e20dd-7f21-49b4-b374-9aa09f4bc3cb {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:05:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updated VIF entry in instance network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:05:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:05:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-716ee62d-bb66-4a5c-8c1a-35b20cca9ff3 req-53b933f6-7da4-40ac-8fa5-4dde8769323a service nova] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:05:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'flavor' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:05:57 user nova-compute[74903]: INFO nova.compute.manager [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Attaching volume bcd027d7-2a7e-4487-b862-ced289e35d79 to /dev/vdb
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.utils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[514883c3-b4f5-4aba-b67c-b3a56bc8782b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e204d789-fe9a-411e-b39f-8100a3ff005a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d6d11-0106-4968-9438-3b899e889493]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a1bea-286f-4c81-a03f-ddb2a42d06be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:05:57 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:05:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc73b5b-861f-4474-ad46-39cceb7d857a]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG os_brick.utils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:05:57 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating existing volume attachment record: 540a7846-0565-49b5-ae40-67771e4bed66 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:05:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:04 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b781713b-1c98-4674-901c-a834bf648636 is timed out.
Nov 06 06:06:04 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Successfully detached device vdb from instance b781713b-1c98-4674-901c-a834bf648636 from the live domain config.
Nov 06 06:06:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIBzePWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '6b060355-7015-4a5f-a3a4-4a870eab766e'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:04 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8584b-e581-4355-a5f1-81ffae8bedde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:06:04 user nova-compute[74903]: No targets found.
Nov 06 06:06:04 user nova-compute[74903]: iSNS:
Nov 06 06:06:04 user nova-compute[74903]: No targets found.
Nov 06 06:06:04 user nova-compute[74903]: STATIC:
Nov 06 06:06:04 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:06:04 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:06:04 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:06:04 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e
Nov 06 06:06:04 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:06:04 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:06:04 user nova-compute[74903]: FIRMWARE:
Nov 06 06:06:04 user nova-compute[74903]: No targets found.
Nov 06 06:06:04 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:06:04 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:06:04 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f215e93-27e2-4e2b-b561-9a68b9f0e6e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5656c52-bbe2-4c0e-ab5a-45124e1ffda2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:06:04 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:04 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e (non-flash)
Nov 06 06:06:04 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:04 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087bdab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb65892c-42a2-4e21-990f-60627af808fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d779154-6473-413f-bab1-372c33495af7]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8cc2ec-df7b-4be2-9b6f-5e8ef4d25ae4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[be584778-0a59-4e9f-bab2-f15952031dea]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ff732-2ede-403b-8291-8a93d1eb1340]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b151e3be-5edb-49a9-9805-d686bca12101]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260]
Nov 06 06:06:04 user nova-compute[74903]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e, portal: 172.16.0.220,3260] successful.
Nov 06 06:06:04 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b060355-7015-4a5f-a3a4-4a870eab766e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3eaf0-55b5-4001-9103-6906ce0face2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] <== disconnect_volume: return (314ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:06:05 user nova-compute[74903]: DEBUG nova.objects.instance [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lazy-loading 'flavor' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19acf713-3e92-4df4-a1f6-3de02e87d0eb tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.009s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fpbmyhqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:07 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:07 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:07 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:06:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df36464-1f5e-4724-b06c-73a77fc87702]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:06:07 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a30324-08b0-41cf-8936-2746a3f5e3a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0] added
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[239070c1-f13b-4bd4-82b2-b677c430fb9f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dce7cd-afca-486a-be17-398e4b00de69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Fpbmyhqi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Fpbmyhqi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253acd7-9469-40f7-b510-4ad75cf5b947]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Fpbmyhqi'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae6122e-72f4-40f9-bf4f-9c803e1cc1f6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f283381-276a-4d9c-aee6-d44787074e31]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[df705b9a-8432-4b0b-8c49-21e99f401c2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260]
Nov 06 06:06:08 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260] successful.
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c1182-6cae-44fe-ae1c-3bbaed708097]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9378d-ce70-4c58-99bd-3c74f87f3a9e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e709cf1-c84c-4de2-9ec3-17d56e1a2d3b]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fpbmyhqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:06:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26534336235353734', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534336235353734', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'flavor' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:06:09 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:06:09 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:06:09 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:06:09 user nova-compute[74903]:   <serial>fd82875d-6c9d-4197-a442-ba11f828cdb0</serial>
Nov 06 06:06:09 user nova-compute[74903]: </disk>
Nov 06 06:06:09 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:a4:d1:48, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:06:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f61462b7-81a4-40ec-bd38-2eceb07c577c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.141s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:06:10 user nova-compute[74903]: INFO nova.compute.manager [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Rescuing
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:11 user nova-compute[74903]: WARNING nova.compute.manager [req-895c8c9f-4524-4a70-a596-16132f9232a5 req-1570faf5-4001-4bb3-a0e8-3c3273ca46f0 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state active and task_state rescuing.
Nov 06 06:06:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance destroyed successfully.
Nov 06 06:06:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Attempting rescue
Nov 06 06:06:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:06:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Creating image(s)
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'trusted_certs' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue" returned: 0 in 0.050s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'migration_context' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.base [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<457a1716-198e-4054-b665-9e9af54f8c09> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start _get_guest_xml network_info=[{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:a4:d1:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.base [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<457a1716-198e-4054-b665-9e9af54f8c09> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'numa_topology' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.base [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<457a1716-198e-4054-b665-9e9af54f8c09> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:06:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:12 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'vcpu_model' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.base [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<457a1716-198e-4054-b665-9e9af54f8c09> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1447677904',display_name='tempest-ServerRescueNegativeTestJSON-server-1447677904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1447677904',id=23,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgW7PD81gI6GHkukGSC3wfWAkjxfJo5pr60EENpM4Z2HWRRQosxm5AXbGhgCV2qNZWJWB6YrehuBw7yS4U+q6mCAMU8o1nME88e5r9FVjP00P90vhBUkLBsd9SnMtA+4w==',key_name='tempest-keypair-970855336',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-wvxbg2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a651fca6654461c81036f79a46892ef',uuid=457a1716-198e-4054-b665-9e9af54f8c09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:a4:d1:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "vif_mac": "fa:16:3e:a4:d1:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'pci_devices' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.objects.base [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Object Instance<457a1716-198e-4054-b665-9e9af54f8c09> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:06:12 user nova-compute[74903]:   <uuid>457a1716-198e-4054-b665-9e9af54f8c09</uuid>
Nov 06 06:06:12 user nova-compute[74903]:   <name>instance-00000017</name>
Nov 06 06:06:12 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:06:12 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:06:12 user nova-compute[74903]:   <metadata>
Nov 06 06:06:12 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:06:12 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1447677904</nova:name>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:06:12</nova:creationTime>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:06:12 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:06:12 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:owner>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:user uuid="4a651fca6654461c81036f79a46892ef">tempest-ServerRescueNegativeTestJSON-21945873-project-member</nova:user>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:project uuid="a8cbdaee9b7f4323a120240fef7ea443">tempest-ServerRescueNegativeTestJSON-21945873</nova:project>
Nov 06 06:06:12 user nova-compute[74903]:       </nova:owner>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:06:12 user nova-compute[74903]:       <nova:ports>
Nov 06 06:06:12 user nova-compute[74903]:         <nova:port uuid="63e0d648-6523-4aa2-8200-7f3e73a45080">
Nov 06 06:06:12 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:06:12 user nova-compute[74903]:         </nova:port>
Nov 06 06:06:12 user nova-compute[74903]:       </nova:ports>
Nov 06 06:06:12 user nova-compute[74903]:     </nova:instance>
Nov 06 06:06:12 user nova-compute[74903]:   </metadata>
Nov 06 06:06:12 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:06:12 user nova-compute[74903]:     <system>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="serial">457a1716-198e-4054-b665-9e9af54f8c09</entry>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="uuid">457a1716-198e-4054-b665-9e9af54f8c09</entry>
Nov 06 06:06:12 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:06:12 user nova-compute[74903]:     </system>
Nov 06 06:06:12 user nova-compute[74903]:   </sysinfo>
Nov 06 06:06:12 user nova-compute[74903]:   <os>
Nov 06 06:06:12 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:06:12 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:06:12 user nova-compute[74903]:   </os>
Nov 06 06:06:12 user nova-compute[74903]:   <features>
Nov 06 06:06:12 user nova-compute[74903]:     <acpi/>
Nov 06 06:06:12 user nova-compute[74903]:     <apic/>
Nov 06 06:06:12 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:06:12 user nova-compute[74903]:   </features>
Nov 06 06:06:12 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:06:12 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:06:12 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:06:12 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:06:12 user nova-compute[74903]:   </clock>
Nov 06 06:06:12 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:06:12 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:06:12 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:06:12 user nova-compute[74903]:   </cpu>
Nov 06 06:06:12 user nova-compute[74903]:   <devices>
Nov 06 06:06:12 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:06:12 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:06:12 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue"/>
Nov 06 06:06:12 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:06:12 user nova-compute[74903]:     </disk>
Nov 06 06:06:12 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:06:12 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:06:12 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk"/>
Nov 06 06:06:12 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:06:12 user nova-compute[74903]:     </disk>
Nov 06 06:06:12 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:06:12 user nova-compute[74903]:       <mac address="fa:16:3e:a4:d1:48"/>
Nov 06 06:06:12 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:06:12 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:06:12 user nova-compute[74903]:       <target dev="tap63e0d648-65"/>
Nov 06 06:06:12 user nova-compute[74903]:     </interface>
Nov 06 06:06:12 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:06:12 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/console.log" append="off"/>
Nov 06 06:06:12 user nova-compute[74903]:     </serial>
Nov 06 06:06:12 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:06:12 user nova-compute[74903]:     <video>
Nov 06 06:06:12 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:06:12 user nova-compute[74903]:     </video>
Nov 06 06:06:12 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:06:12 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:06:12 user nova-compute[74903]:     </rng>
Nov 06 06:06:12 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:06:12 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:06:12 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:06:12 user nova-compute[74903]:     </memballoon>
Nov 06 06:06:12 user nova-compute[74903]:   </devices>
Nov 06 06:06:12 user nova-compute[74903]: </domain>
Nov 06 06:06:12 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:06:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance destroyed successfully.
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] No VIF found with MAC fa:16:3e:a4:d1:48, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:13 user nova-compute[74903]: WARNING nova.compute.manager [req-5ce765b7-87c2-4b6a-9bac-8f780be79446 req-88c8e136-b18b-4ff7-819a-a4c854927b16 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state active and task_state rescuing.
Nov 06 06:06:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:15 user nova-compute[74903]: WARNING nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state active and task_state rescuing.
Nov 06 06:06:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:15 user nova-compute[74903]: WARNING nova.compute.manager [req-dbd1defa-8d73-450a-88c7-800f275374eb req-7c9c5a5f-e7a4-4b7d-ba44-d428611dbd31 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state active and task_state rescuing.
Nov 06 06:06:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-50824f45-6f6e-44d6-b1af-a65851cc4a2c tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.333s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:21 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:21 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.251312255859375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b781713b-1c98-4674-901c-a834bf648636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 673648d8-b84a-43ff-8e2b-e52702a198be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:06:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:06:24 user nova-compute[74903]: INFO nova.compute.manager [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] instance snapshotting
Nov 06 06:06:24 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Beginning live snapshot process
Nov 06 06:06:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f.delta 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f.delta 1073741824" returned: 0 in 0.052s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:25 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 06:06:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:06:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] COPY block job progress, current cursor: 27197440 final cursor: 75497472 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:06:27 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 06:06:27 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f.delta /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:06:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f.delta /opt/stack/data/nova/instances/snapshots/tmprtkjgrl0/d8ad08e317404f518131f55ae20eb93f" returned: 0 in 0.700s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:27 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Snapshot extracted, beginning image upload
Nov 06 06:06:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Snapshot image upload complete
Nov 06 06:06:30 user nova-compute[74903]: INFO nova.compute.manager [None req-e9a25c27-b976-475e-8fc0-3dc09f592d79 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Took 6.08 seconds to snapshot the instance on the hypervisor.
Nov 06 06:06:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:31 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:31 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:31 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e2efa8-197a-48aa-9180-207f7de8c30d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:06:31 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59276a6-6e2b-4242-be6c-dee64636f457]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.095s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ebc52-07b9-4978-a2e3-67ceb8925089]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eac6c0-dab6-4c55-9940-9b69a0e38a12]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcde53e-cd9e-4f59-8958-ba66fcba1a9b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdBANyfC'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3908f62-ce4d-414e-80dc-14539cce8f08]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b929a4-d65e-437c-a902-0ac38a3a49f1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a5cb8-a1a1-4ccc-934b-5a11f6c7b566]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:06:31 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d6d91-036f-4d5d-8791-eb7859c13b69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa2bf1-7dbc-4791-ab87-286dee6dc2d2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:06:31 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3aca6-ed0b-4143-9f30-14859cc9497c]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:06:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:06:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:06:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'flavor' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:06:32 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:06:32 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:06:32 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:06:32 user nova-compute[74903]:   <serial>bcd027d7-2a7e-4487-b862-ced289e35d79</serial>
Nov 06 06:06:32 user nova-compute[74903]: </disk>
Nov 06 06:06:32 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No VIF found with MAC fa:16:3e:dd:89:27, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d52e2aec-a890-4844-9211-d03033ee5cf5 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.775s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:33 user nova-compute[74903]: INFO nova.compute.manager [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Terminating instance
Nov 06 06:06:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe200fdf-c100-4bc7-b173-db74fd44a364 req-945f60ae-7106-4d6b-91d9-c0a1738e8444 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b781713b-1c98-4674-901c-a834bf648636] Instance destroyed successfully.
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lazy-loading 'resources' on Instance uuid b781713b-1c98-4674-901c-a834bf648636 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:00:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1280916315',display_name='tempest-TestVolumeSwap-server-1280916315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1280916315',id=16,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxU3FOvhIUFxcuFF/GXGAAhqWLdDNEQbFPDoCM46c2SYRb25E/xpIBPIhSxgFzdS3tNsi7I+U2stPFZ1NfdjbvsMz8jOP822BYaS1BnbHFAsGTnH9sPY0pG9W1922e6gQ==',key_name='tempest-keypair-1457777091',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09e5d028d7f14e9898af48f92a1e3649',ramdisk_id='',reservation_id='r-gnksmr6k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1869559139',owner_user_name='tempest-TestVolumeSwap-1869559139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3960cc6199469581346258d3da93e4',uuid=b781713b-1c98-4674-901c-a834bf648636,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converting VIF {"id": "624be246-f0a3-4448-9c3b-8bfba73e4685", "address": "fa:16:3e:c6:ab:93", "network": {"id": "914f21a9-ad6c-4a2f-9dc8-d0514a322466", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1890048796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09e5d028d7f14e9898af48f92a1e3649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624be246-f0", "ovs_interfaceid": "624be246-f0a3-4448-9c3b-8bfba73e4685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG os_vif [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624be246-f0, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1651742b-78c0-436c-9032-1386fa39d6f6) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:34 user nova-compute[74903]: INFO os_vif [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ab:93,bridge_name='br-int',has_traffic_filtering=True,id=624be246-f0a3-4448-9c3b-8bfba73e4685,network=Network(914f21a9-ad6c-4a2f-9dc8-d0514a322466),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624be246-f0')
Nov 06 06:06:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Deleting instance files /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636_del
Nov 06 06:06:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Deletion of /opt/stack/data/nova/instances/b781713b-1c98-4674-901c-a834bf648636_del complete
Nov 06 06:06:35 user nova-compute[74903]: INFO nova.compute.manager [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] [instance: b781713b-1c98-4674-901c-a834bf648636] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: b781713b-1c98-4674-901c-a834bf648636] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: b781713b-1c98-4674-901c-a834bf648636] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:06:35 user nova-compute[74903]: INFO nova.compute.claims [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Claim successful on node user
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Stashing vm_state: active {{(pid=74903) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.claims [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Claim successful on node user
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:06:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating resource usage from migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6
Nov 06 06:06:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.policy [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd524e206cbd74470ac85aaad34748925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0407911ca4ad4d06a00c04da2a5b121c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: b781713b-1c98-4674-901c-a834bf648636] Took 1.23 seconds to deallocate network for instance.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-84bab4e9-665d-4b17-af0b-e19648aa4306 req-dc30a2b5-d773-4659-91f6-6b8135bb8ccd service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-deleted-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.manager [req-84bab4e9-665d-4b17-af0b-e19648aa4306 req-dc30a2b5-d773-4659-91f6-6b8135bb8ccd service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Neutron deleted interface 624be246-f0a3-4448-9c3b-8bfba73e4685; detaching it from the instance and deleting it from the info cache
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-84bab4e9-665d-4b17-af0b-e19648aa4306 req-dc30a2b5-d773-4659-91f6-6b8135bb8ccd service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Creating image(s)
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "/opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "/opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "/opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-84bab4e9-665d-4b17-af0b-e19648aa4306 req-dc30a2b5-d773-4659-91f6-6b8135bb8ccd service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Detach interface failed, port_id=624be246-f0a3-4448-9c3b-8bfba73e4685, reason: Instance b781713b-1c98-4674-901c-a834bf648636 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:36 user nova-compute[74903]: WARNING nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state deleted and task_state None.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:36 user nova-compute[74903]: WARNING nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state deleted and task_state None.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:36 user nova-compute[74903]: WARNING nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state deleted and task_state None.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:36 user nova-compute[74903]: WARNING nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-unplugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state deleted and task_state None.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Acquiring lock "b781713b-1c98-4674-901c-a834bf648636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] Lock "b781713b-1c98-4674-901c-a834bf648636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] No waiting events found dispatching network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:36 user nova-compute[74903]: WARNING nova.compute.manager [req-5f1cebc0-260d-4dae-ab64-f64d90b3442a req-cf57666e-0b40-492f-85b2-ab5e8d2b6f27 service nova] [instance: b781713b-1c98-4674-901c-a834bf648636] Received unexpected event network-vif-plugged-624be246-f0a3-4448-9c3b-8bfba73e4685 for instance with vm_state deleted and task_state None.
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk 1073741824" returned: 0 in 0.064s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.861s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.manager [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Migrating
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.534s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:36 user nova-compute[74903]: INFO nova.compute.rpcapi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 06 06:06:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Successfully created port: f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Cannot resize image /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Ensure instance console log exists: /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:37 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Deleted allocations for instance b781713b-1c98-4674-901c-a834bf648636
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b652e0d-0a07-472b-8767-7e7c12918a05 tempest-TestVolumeSwap-1869559139 tempest-TestVolumeSwap-1869559139-project-member] Lock "b781713b-1c98-4674-901c-a834bf648636" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.659s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Starting migrate_disk_and_power_off {{(pid=74903) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Successfully updated port: f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquired lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-changed-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Refreshing instance network info cache due to event network-changed-f7e673b9-383b-490a-93eb-a678271f9171. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] Acquiring lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Updating instance_info_cache with network_info: [{"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Releasing lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Instance network_info: |[{"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] Acquired lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.neutron [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Refreshing network info cache for port f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Start _get_guest_xml network_info=[{"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:06:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761149164',display_name='tempest-VolumesActionsTest-instance-1761149164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761149164',id=26,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-177ai0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:36Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=01eff73b-21e7-4cdb-bffe-973d3e13c6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lazy-loading 'pci_devices' on Instance uuid 01eff73b-21e7-4cdb-bffe-973d3e13c6e0 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance destroyed successfully.
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG os_vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd470b96-80, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d707fb4-ebb8-493f-9cd3-851e82330db2) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:06:39 user nova-compute[74903]:   <uuid>01eff73b-21e7-4cdb-bffe-973d3e13c6e0</uuid>
Nov 06 06:06:39 user nova-compute[74903]:   <name>instance-0000001a</name>
Nov 06 06:06:39 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:06:39 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:06:39 user nova-compute[74903]:   <metadata>
Nov 06 06:06:39 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:06:39 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:name>tempest-VolumesActionsTest-instance-1761149164</nova:name>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:06:38</nova:creationTime>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:06:39 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:06:39 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:owner>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:user uuid="d524e206cbd74470ac85aaad34748925">tempest-VolumesActionsTest-1503865399-project-member</nova:user>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:project uuid="0407911ca4ad4d06a00c04da2a5b121c">tempest-VolumesActionsTest-1503865399</nova:project>
Nov 06 06:06:39 user nova-compute[74903]:       </nova:owner>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:06:39 user nova-compute[74903]:       <nova:ports>
Nov 06 06:06:39 user nova-compute[74903]:         <nova:port uuid="f7e673b9-383b-490a-93eb-a678271f9171">
Nov 06 06:06:39 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:06:39 user nova-compute[74903]:         </nova:port>
Nov 06 06:06:39 user nova-compute[74903]:       </nova:ports>
Nov 06 06:06:39 user nova-compute[74903]:     </nova:instance>
Nov 06 06:06:39 user nova-compute[74903]:   </metadata>
Nov 06 06:06:39 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:06:39 user nova-compute[74903]:     <system>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="serial">01eff73b-21e7-4cdb-bffe-973d3e13c6e0</entry>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="uuid">01eff73b-21e7-4cdb-bffe-973d3e13c6e0</entry>
Nov 06 06:06:39 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:06:39 user nova-compute[74903]:     </system>
Nov 06 06:06:39 user nova-compute[74903]:   </sysinfo>
Nov 06 06:06:39 user nova-compute[74903]:   <os>
Nov 06 06:06:39 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:06:39 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:06:39 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:06:39 user nova-compute[74903]:   </os>
Nov 06 06:06:39 user nova-compute[74903]:   <features>
Nov 06 06:06:39 user nova-compute[74903]:     <acpi/>
Nov 06 06:06:39 user nova-compute[74903]:     <apic/>
Nov 06 06:06:39 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:06:39 user nova-compute[74903]:   </features>
Nov 06 06:06:39 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:06:39 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:06:39 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:06:39 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:06:39 user nova-compute[74903]:   </clock>
Nov 06 06:06:39 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:06:39 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:06:39 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:06:39 user nova-compute[74903]:   </cpu>
Nov 06 06:06:39 user nova-compute[74903]:   <devices>
Nov 06 06:06:39 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:06:39 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:06:39 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk"/>
Nov 06 06:06:39 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:06:39 user nova-compute[74903]:     </disk>
Nov 06 06:06:39 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:06:39 user nova-compute[74903]:       <mac address="fa:16:3e:2d:07:89"/>
Nov 06 06:06:39 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:06:39 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:06:39 user nova-compute[74903]:       <target dev="tapf7e673b9-38"/>
Nov 06 06:06:39 user nova-compute[74903]:     </interface>
Nov 06 06:06:39 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:06:39 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/console.log" append="off"/>
Nov 06 06:06:39 user nova-compute[74903]:     </serial>
Nov 06 06:06:39 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:06:39 user nova-compute[74903]:     <video>
Nov 06 06:06:39 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:06:39 user nova-compute[74903]:     </video>
Nov 06 06:06:39 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:06:39 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:06:39 user nova-compute[74903]:     </rng>
Nov 06 06:06:39 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:06:39 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:06:39 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:06:39 user nova-compute[74903]:     </memballoon>
Nov 06 06:06:39 user nova-compute[74903]:   </devices>
Nov 06 06:06:39 user nova-compute[74903]: </domain>
Nov 06 06:06:39 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761149164',display_name='tempest-VolumesActionsTest-instance-1761149164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761149164',id=26,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-177ai0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:36Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=01eff73b-21e7-4cdb-bffe-973d3e13c6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_vif [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82846119-d274-51d1-b8a2-27e0fb66b26d', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: INFO os_vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:39 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7e673b9-38, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7e673b9-38, col_values=(('qos', UUID('340793f5-5762-437d-b1c4-fc9cf0044fa1')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7e673b9-38, col_values=(('external_ids', {'iface-id': 'f7e673b9-383b-490a-93eb-a678271f9171', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:07:89', 'vm-uuid': '01eff73b-21e7-4cdb-bffe-973d3e13c6e0'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7db098-e213-4e94-bdfc-c1c25fd7b256]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:06:39 user nova-compute[74903]: No targets found.
Nov 06 06:06:39 user nova-compute[74903]: iSNS:
Nov 06 06:06:39 user nova-compute[74903]: No targets found.
Nov 06 06:06:39 user nova-compute[74903]: STATIC:
Nov 06 06:06:39 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:06:39 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:06:39 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:06:39 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:06:39 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:06:39 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:06:39 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:06:39 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:06:39 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:06:39 user nova-compute[74903]: FIRMWARE:
Nov 06 06:06:39 user nova-compute[74903]: No targets found.
Nov 06 06:06:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:06:39 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:06:39 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:39 user nova-compute[74903]: INFO os_vif [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38')
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b800d822-c71b-4c06-afe1-a5c251974244]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e3f64f-0de1-4043-8652-c24a5343665e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:39 user nova-compute[74903]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:06:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:06:39 user nova-compute[74903]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:06:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:06:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa286f6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] No VIF found with MAC fa:16:3e:2d:07:89, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875da25-7e3a-431c-913e-64fa5119e8e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8424c64b-679e-4c1b-9b4f-f1f094fd5c71]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6450ef9a-103b-4452-81ab-26784e05f294]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bbdb47-7078-4e12-923a-b54eb85e8813]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa91a7a0-bb91-4400-9cb0-2012b96df4b1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.network.neutron [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Updated VIF entry in instance network info cache for port f7e673b9-383b-490a-93eb-a678271f9171. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.network.neutron [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Updating instance_info_cache with network_info: [{"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d08ed328-6562-458d-a23a-1acca0cefc72 req-88198a75-74c0-4c62-9abc-efef6566f341 service nova] Releasing lock "refresh_cache-01eff73b-21e7-4cdb-bffe-973d3e13c6e0" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d797b2af-8bc8-4201-9cb0-4038be66f8af]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:06:39 user nova-compute[74903]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:06:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabdf71-1d01-49ef-ae5f-6b51417b0500]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== disconnect_volume: return (344ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:06:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_resize/disk /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-changed-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Refreshing instance network info cache due to event network-changed-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] Acquiring lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] Acquired lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.network.neutron [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Refreshing network info cache for port 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:40 user nova-compute[74903]: WARNING nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state active and task_state resize_migrating.
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:40 user nova-compute[74903]: WARNING nova.compute.manager [req-db046bb1-e07f-4e19-8312-b0e2e5d0dc22 req-eeb73d9a-cfc5-40dd-96fb-4ea44dfa0e91 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state active and task_state resize_migrating.
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "cp -r /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_resize/disk /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk" returned: 0 in 0.505s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_resize/disk.info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk.info {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "cp -r /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_resize/disk.info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk.info" returned: 0 in 0.044s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Ignoring supplied device name: /dev/vdb
Nov 06 06:06:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:40 user nova-compute[74903]: INFO nova.compute.manager [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Attaching volume 1cd08391-8348-4601-b855-d8696dc6a496 to /dev/vdb
Nov 06 06:06:41 user nova-compute[74903]: DEBUG nova.network.neutron [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updated VIF entry in instance network info cache for port 3229e50e-e2b1-44c3-b1f1-baa9227ffb2a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG nova.network.neutron [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updating instance_info_cache with network_info: [{"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ccfd2cf2-b370-4b60-bc71-9c7babd3eb2c req-52e73bc2-6daf-454e-9d37-ed23ef298462 service nova] Releasing lock "refresh_cache-673648d8-b84a-43ff-8e2b-e52702a198be" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afcaf30-a885-49e4-8a53-4d78a67b3741]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d5ef6-b599-4fc2-9df7-5d3a691dd681]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b912e4-7afa-4261-8372-9a5a9dc4da04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc18e5c-4f9c-4822-9b53-db9892658441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:41 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c2a10-5304-4671-bb04-2c518eea9cd3]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updating existing volume attachment record: 773a6518-00e8-4519-bb84-29ca7eb9786a {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Port bd470b96-807a-4d77-8af1-362676fa3552 binding to destination host user is already ACTIVE {{(pid=74903) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] No waiting events found dispatching network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:42 user nova-compute[74903]: WARNING nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received unexpected event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 for instance with vm_state building and task_state spawning.
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] No waiting events found dispatching network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:06:42 user nova-compute[74903]: WARNING nova.compute.manager [req-05f204e6-343b-496e-8de4-1bd864c10e54 req-7ff4f7d0-4e8a-41e7-ba51-dddb8bf6ac82 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received unexpected event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 for instance with vm_state building and task_state spawning.
Nov 06 06:06:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.utils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a013220-f17e-4c00-a3d6-d619530212e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7030103f-45be-485f-8375-62473571551b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e1a2d9-6b70-46ea-b6b1-0ae04100a998]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6ce88-cffc-46a5-ac55-89ee9b53f918]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:42 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:06:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a3278-e3b5-4f38-aa0e-5bc26172920c]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:06:42 user nova-compute[74903]: DEBUG os_brick.utils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:06:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Instance spawned successfully.
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:06:43 user nova-compute[74903]: INFO nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Took 6.94 seconds to spawn the instance on the hypervisor.
Nov 06 06:06:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:06:43 user nova-compute[74903]: INFO nova.compute.manager [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Took 8.28 seconds to build instance.
Nov 06 06:06:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3759d102-560b-4b98-b26c-61ec174d76ba tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.409s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:06:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:06:48 user nova-compute[74903]: INFO nova.compute.manager [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Unshelving
Nov 06 06:06:48 user nova-compute[74903]: INFO nova.virt.block_device [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Booting with volume 6a08b890-5548-44b9-b510-29668799b6b3 at /dev/vdc
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.utils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad56be7-c950-4907-bd10-4ee117268c5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687d889-32f8-417c-896c-2435eb4c07c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[081f2831-0965-48bb-bb98-b1a3ca4ed81c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2590c602-fcfe-402a-910f-6a7b96b7e232]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:06:48 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:06:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b51c15-5e8c-4c5a-a9c8-f1b21b8f79d2]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG os_brick.utils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:06:48 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating existing volume attachment record: d5cbc776-5c7b-492d-828b-5208c1893935 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:06:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:06:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Starting finish_migration {{(pid=74903) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:07:06 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Creating image(s)
Nov 06 06:07:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk. size=21474836480 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:07:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk 21474836480 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk 21474836480" returned: 0 in 0.050s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Ensure instance console log exists: /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start _get_guest_xml network_info=[{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3cff20f3-7370-43ad-a050-1cbd107aaf52', 'attached_at': '2023-11-06T06:07:06.000000', 'detached_at': '', 'volume_id': 'bcd027d7-2a7e-4487-b862-ced289e35d79', 'serial': 'bcd027d7-2a7e-4487-b862-ced289e35d79'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '27921f71-4e14-4ef7-97e1-2bc164e07aa6', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:07:07 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:07 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:07 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:07 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:07 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f7e90-2eda-4551-b8c5-88989d226319]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:07:07 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2bc73a-3ac4-4bd1-8bdf-c957d77da3cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e10d5c8-dc36-4065-9625-2cc29f5218d1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc5c6d1-010b-4718-b737-bda7c9067d6b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a76027-f71a-458a-967f-ab1ed0959add]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdBANyfC'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced499f-d394-470d-b2d9-40cb445ae12a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c167817c-32b4-453f-9b93-8308eac90911]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login" returned: 0 in 0.162s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fe5fd7-95e7-4811-8492-c09c7e383f63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:07:07 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b06aa88-f2e0-431b-928d-dc78e3b1176e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3de7a42-ab15-427a-8807-5c085709520f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d33e8e-d45b-4d92-97eb-bc2d07c038dd]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:07:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:07:08 user nova-compute[74903]:   <uuid>3cff20f3-7370-43ad-a050-1cbd107aaf52</uuid>
Nov 06 06:07:08 user nova-compute[74903]:   <name>instance-00000014</name>
Nov 06 06:07:08 user nova-compute[74903]:   <memory>2097152</memory>
Nov 06 06:07:08 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:07:08 user nova-compute[74903]:   <metadata>
Nov 06 06:07:08 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:07:08 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherB-server-1513746207</nova:name>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:07:07</nova:creationTime>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:flavor name="m1.small">
Nov 06 06:07:08 user nova-compute[74903]:         <nova:memory>2048</nova:memory>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:disk>20</nova:disk>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:07:08 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:owner>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:user uuid="5380e1aa9f6c43dda84e1528cb964a55">tempest-ServerActionsTestOtherB-325946081-project-member</nova:user>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:project uuid="fd56e3653ea34efcab24bd58a8b2d6d8">tempest-ServerActionsTestOtherB-325946081</nova:project>
Nov 06 06:07:08 user nova-compute[74903]:       </nova:owner>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:07:08 user nova-compute[74903]:       <nova:ports>
Nov 06 06:07:08 user nova-compute[74903]:         <nova:port uuid="bd470b96-807a-4d77-8af1-362676fa3552">
Nov 06 06:07:08 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:07:08 user nova-compute[74903]:         </nova:port>
Nov 06 06:07:08 user nova-compute[74903]:       </nova:ports>
Nov 06 06:07:08 user nova-compute[74903]:     </nova:instance>
Nov 06 06:07:08 user nova-compute[74903]:   </metadata>
Nov 06 06:07:08 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:07:08 user nova-compute[74903]:     <system>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="serial">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="uuid">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:07:08 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:07:08 user nova-compute[74903]:     </system>
Nov 06 06:07:08 user nova-compute[74903]:   </sysinfo>
Nov 06 06:07:08 user nova-compute[74903]:   <os>
Nov 06 06:07:08 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:07:08 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:07:08 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:07:08 user nova-compute[74903]:   </os>
Nov 06 06:07:08 user nova-compute[74903]:   <features>
Nov 06 06:07:08 user nova-compute[74903]:     <acpi/>
Nov 06 06:07:08 user nova-compute[74903]:     <apic/>
Nov 06 06:07:08 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:07:08 user nova-compute[74903]:   </features>
Nov 06 06:07:08 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:07:08 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:07:08 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:07:08 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:07:08 user nova-compute[74903]:   </clock>
Nov 06 06:07:08 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:07:08 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:07:08 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:07:08 user nova-compute[74903]:   </cpu>
Nov 06 06:07:08 user nova-compute[74903]:   <devices>
Nov 06 06:07:08 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:07:08 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:07:08 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk"/>
Nov 06 06:07:08 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:07:08 user nova-compute[74903]:     </disk>
Nov 06 06:07:08 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:07:08 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:07:08 user nova-compute[74903]:       <source dev="/dev/sdd"/>
Nov 06 06:07:08 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:07:08 user nova-compute[74903]:       <serial>bcd027d7-2a7e-4487-b862-ced289e35d79</serial>
Nov 06 06:07:08 user nova-compute[74903]:     </disk>
Nov 06 06:07:08 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:07:08 user nova-compute[74903]:       <mac address="fa:16:3e:dd:89:27"/>
Nov 06 06:07:08 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:08 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:07:08 user nova-compute[74903]:       <target dev="tapbd470b96-80"/>
Nov 06 06:07:08 user nova-compute[74903]:     </interface>
Nov 06 06:07:08 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:07:08 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/console.log" append="off"/>
Nov 06 06:07:08 user nova-compute[74903]:     </serial>
Nov 06 06:07:08 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:07:08 user nova-compute[74903]:     <video>
Nov 06 06:07:08 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:08 user nova-compute[74903]:     </video>
Nov 06 06:07:08 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:07:08 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:07:08 user nova-compute[74903]:     </rng>
Nov 06 06:07:08 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:07:08 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:07:08 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:07:08 user nova-compute[74903]:     </memballoon>
Nov 06 06:07:08 user nova-compute[74903]:   </devices>
Nov 06 06:07:08 user nova-compute[74903]: </domain>
Nov 06 06:07:08 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1124072097-network", "vif_mac": "fa:16:3e:dd:89:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG os_vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff1159ac-1c50-5d24-88b3-e9d2b4c3b4ff', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd470b96-80, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd470b96-80, col_values=(('qos', UUID('687097c1-4673-4f3f-ab0b-74df850decc6')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd470b96-80, col_values=(('external_ids', {'iface-id': 'bd470b96-807a-4d77-8af1-362676fa3552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:89:27', 'vm-uuid': '3cff20f3-7370-43ad-a050-1cbd107aaf52'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:08 user nova-compute[74903]: INFO os_vif [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] No VIF found with MAC fa:16:3e:dd:89:27, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:11 user nova-compute[74903]: WARNING nova.compute.manager [req-f4955d91-9a72-48c0-940c-8f6cb83044d1 req-d7d3e8ab-28a9-4476-9624-d7faea1ff404 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state active and task_state resize_finish.
Nov 06 06:07:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:07:12 user nova-compute[74903]: INFO nova.compute.claims [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Claim successful on node user
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:12 user nova-compute[74903]: INFO nova.network.neutron [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:07:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance running successfully.
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Failed to set time: agent not configured {{(pid=74903) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 06:07:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9927751c-14ed-4cbb-b39b-64f004edecfd tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] finish_migration finished successfully. {{(pid=74903) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:13 user nova-compute[74903]: WARNING nova.compute.manager [req-2a95ac42-e5cf-4b19-9e95-6128f39dc719 req-41febada-8ab3-410e-acfa-2185e9ed73c0 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state active and task_state resize_finish.
Nov 06 06:07:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:07:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:07:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Creating image(s)
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<6a685cae-989a-473d-80b9-ded3974de38c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "2178407ac970efbfaef736777990d3b25583db35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "2178407ac970efbfaef736777990d3b25583db35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing instance network info cache due to event network-changed-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] Acquiring lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] Acquired lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.network.neutron [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Refreshing network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.part --force-share --output=json" returned: 0 in 0.225s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.virt.images [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] b879b71d-7b33-41ee-836c-d52cdf05a1c5 was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.part /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.part /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.converted" returned: 0 in 0.295s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updated VIF entry in instance network info cache for port e1d84ce5-1ca7-4cbc-a19a-379a9dec744a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-feaf5510-3c72-4137-8313-d99937df51a3 req-0f164e77-579f-42a4-9b77-35fd34281ce7 service nova] Releasing lock "refresh_cache-6a685cae-989a-473d-80b9-ded3974de38c" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "2178407ac970efbfaef736777990d3b25583db35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.038s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "2178407ac970efbfaef736777990d3b25583db35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "2178407ac970efbfaef736777990d3b25583db35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json" returned: 0 in 0.232s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35,backing_fmt=raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35,backing_fmt=raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk 1073741824" returned: 0 in 0.057s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "2178407ac970efbfaef736777990d3b25583db35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'migration_context' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:16 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<6a685cae-989a-473d-80b9-ded3974de38c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:07:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Rebasing disk image.
Nov 06 06:07:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.238s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da -F raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.378s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.298s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da -F raw /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk" returned: 0 in 2.747s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Ensure instance console log exists: /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start _get_guest_xml network_info=[{"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3dcfa5c21de438bba273d68c3697b1f9',container_format='bare',created_at=2023-11-06T06:04:55Z,direct_url=<?>,disk_format='qcow2',id=b879b71d-7b33-41ee-836c-d52cdf05a1c5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1784805946-shelved',owner='371e43fd9d594cd6afca5da129747603',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:05:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWNyznJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6a685cae-989a-473d-80b9-ded3974de38c', 'attached_at': '', 'detached_at': '', 'volume_id': '6a08b890-5548-44b9-b510-29668799b6b3', 'serial': '6a08b890-5548-44b9-b510-29668799b6b3'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'd5cbc776-5c7b-492d-828b-5208c1893935', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:07:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3dcfa5c21de438bba273d68c3697b1f9',container_format='bare',created_at=2023-11-06T06:04:55Z,direct_url=<?>,disk_format='qcow2',id=b879b71d-7b33-41ee-836c-d52cdf05a1c5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1784805946-shelved',owner='371e43fd9d594cd6afca5da129747603',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:05:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<6a685cae-989a-473d-80b9-ded3974de38c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWNyznJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:19 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:20 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:20 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38f2c6-5950-43c3-8259-f31e987e5b46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:07:20 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[932e7bcb-e1dc-4e74-a391-55726ef891a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3] added
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea871f70-7e38-442d-b015-d4665f2b715b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f339f-08e1-4269-8009-8eeb46ae1a91]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWNyznJT {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWNyznJT" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5549df68-4e45-412d-a5d5-b86cb77f605b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWNyznJT'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe5135-1507-4173-9017-b401039d2dee]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1826690a-b423-4360-afd7-c8772872cb9e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93fb98-f171-467f-8053-9ebe20d33f69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260]
Nov 06 06:07:20 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260] successful.
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adf2700-c6b9-490f-9307-ecfd22b665f3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a253ee0-04aa-47a5-8fc9-7fb06d886b1c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a3da5-e164-4740-865b-e87bd7d5a73e]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWNyznJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23833333731623131', 'path': '/dev/sde'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833333731623131', 'path': '/dev/sde'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='b879b71d-7b33-41ee-836c-d52cdf05a1c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-610860067',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:05:00.553216',shelved_host='user',shelved_image_id='b879b71d-7b33-41ee-836c-d52cdf05a1c5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.objects.base [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<6a685cae-989a-473d-80b9-ded3974de38c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:07:21 user nova-compute[74903]:   <uuid>6a685cae-989a-473d-80b9-ded3974de38c</uuid>
Nov 06 06:07:21 user nova-compute[74903]:   <name>instance-00000013</name>
Nov 06 06:07:21 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:07:21 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:07:21 user nova-compute[74903]:   <metadata>
Nov 06 06:07:21 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:07:21 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1784805946</nova:name>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:07:19</nova:creationTime>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:07:21 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:07:21 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:owner>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:user uuid="16796bd87812434689edbdde4d086818">tempest-AttachVolumeShelveTestJSON-1668474455-project-member</nova:user>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:project uuid="371e43fd9d594cd6afca5da129747603">tempest-AttachVolumeShelveTestJSON-1668474455</nova:project>
Nov 06 06:07:21 user nova-compute[74903]:       </nova:owner>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:root type="image" uuid="b879b71d-7b33-41ee-836c-d52cdf05a1c5"/>
Nov 06 06:07:21 user nova-compute[74903]:       <nova:ports>
Nov 06 06:07:21 user nova-compute[74903]:         <nova:port uuid="e1d84ce5-1ca7-4cbc-a19a-379a9dec744a">
Nov 06 06:07:21 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:07:21 user nova-compute[74903]:         </nova:port>
Nov 06 06:07:21 user nova-compute[74903]:       </nova:ports>
Nov 06 06:07:21 user nova-compute[74903]:     </nova:instance>
Nov 06 06:07:21 user nova-compute[74903]:   </metadata>
Nov 06 06:07:21 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:07:21 user nova-compute[74903]:     <system>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="serial">6a685cae-989a-473d-80b9-ded3974de38c</entry>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="uuid">6a685cae-989a-473d-80b9-ded3974de38c</entry>
Nov 06 06:07:21 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:07:21 user nova-compute[74903]:     </system>
Nov 06 06:07:21 user nova-compute[74903]:   </sysinfo>
Nov 06 06:07:21 user nova-compute[74903]:   <os>
Nov 06 06:07:21 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:07:21 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:07:21 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:07:21 user nova-compute[74903]:   </os>
Nov 06 06:07:21 user nova-compute[74903]:   <features>
Nov 06 06:07:21 user nova-compute[74903]:     <acpi/>
Nov 06 06:07:21 user nova-compute[74903]:     <apic/>
Nov 06 06:07:21 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:07:21 user nova-compute[74903]:   </features>
Nov 06 06:07:21 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:07:21 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:07:21 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:07:21 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:07:21 user nova-compute[74903]:   </clock>
Nov 06 06:07:21 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:07:21 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:07:21 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:07:21 user nova-compute[74903]:   </cpu>
Nov 06 06:07:21 user nova-compute[74903]:   <devices>
Nov 06 06:07:21 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:07:21 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:07:21 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk"/>
Nov 06 06:07:21 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:07:21 user nova-compute[74903]:     </disk>
Nov 06 06:07:21 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:07:21 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:07:21 user nova-compute[74903]:       <source dev="/dev/sde"/>
Nov 06 06:07:21 user nova-compute[74903]:       <target dev="vdc" bus="virtio"/>
Nov 06 06:07:21 user nova-compute[74903]:       <serial>6a08b890-5548-44b9-b510-29668799b6b3</serial>
Nov 06 06:07:21 user nova-compute[74903]:     </disk>
Nov 06 06:07:21 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:07:21 user nova-compute[74903]:       <mac address="fa:16:3e:b7:be:02"/>
Nov 06 06:07:21 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:21 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:07:21 user nova-compute[74903]:       <target dev="tape1d84ce5-1c"/>
Nov 06 06:07:21 user nova-compute[74903]:     </interface>
Nov 06 06:07:21 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:07:21 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/console.log" append="off"/>
Nov 06 06:07:21 user nova-compute[74903]:     </serial>
Nov 06 06:07:21 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:07:21 user nova-compute[74903]:     <video>
Nov 06 06:07:21 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:21 user nova-compute[74903]:     </video>
Nov 06 06:07:21 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:07:21 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:07:21 user nova-compute[74903]:     </rng>
Nov 06 06:07:21 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:07:21 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:07:21 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:07:21 user nova-compute[74903]:     </memballoon>
Nov 06 06:07:21 user nova-compute[74903]:   </devices>
Nov 06 06:07:21 user nova-compute[74903]: </domain>
Nov 06 06:07:21 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='b879b71d-7b33-41ee-836c-d52cdf05a1c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-610860067',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:05:00.553216',shelved_host='user',shelved_image_id='b879b71d-7b33-41ee-836c-d52cdf05a1c5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG os_vif [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362f32ff-e4be-5714-9289-20a4c3ee624d', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d84ce5-1c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1d84ce5-1c, col_values=(('qos', UUID('05d47e71-2852-4e87-89a5-ea11af431200')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1d84ce5-1c, col_values=(('external_ids', {'iface-id': 'e1d84ce5-1ca7-4cbc-a19a-379a9dec744a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:be:02', 'vm-uuid': '6a685cae-989a-473d-80b9-ded3974de38c'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:21 user nova-compute[74903]: INFO os_vif [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c')
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No VIF found with MAC fa:16:3e:b7:be:02, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:23 user nova-compute[74903]: WARNING nova.compute.manager [req-96ee750f-6bd2-4d94-a78f-af5eddacd509 req-6b2baa19-7b5a-4534-b03a-2970c638fdb9 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:07:23 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:23 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7440MB free_disk=25.066139221191406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Applying migration context for instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 as it has an incoming, in-progress migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6. Migration status is finished {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 06:07:23 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating resource usage from migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 673648d8-b84a-43ff-8e2b-e52702a198be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 01eff73b-21e7-4cdb-bffe-973d3e13c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (ff4fb787-d54c-4cc6-9e4b-13f1ebe11772): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:23 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:07:24 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:07:24 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:07:24 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:07:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.958s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:25 user nova-compute[74903]: WARNING nova.compute.manager [req-6d9d14fc-c735-486b-8513-906c3d3664be req-aff78ae4-3221-4e6b-9a1e-3df1160ad4c0 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:07:25 user nova-compute[74903]: INFO nova.compute.claims [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Claim successful on node user
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:07:25 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance spawned successfully.
Nov 06 06:07:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0f6aeeef-8d86-4e1d-9f01-6e34d26dc7aa tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.779s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:07:26 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:07:26 user nova-compute[74903]: INFO nova.virt.block_device [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Booting with volume cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b at /dev/vda
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.policy [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44c3df905516436e8a6c39e0f32a2e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b574412f0d4156a9d4538b17b2c163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefdf901-83e0-4f77-9010-0536732f5449]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c455fe1-1595-448d-a8b7-e259e01145f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d47f34b-cf14-4a79-a963-dde7207af1cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c534f-83c3-4159-b11a-d5668e559d19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:07:26 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:07:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd0a09-326a-4a87-91a6-687fee2897aa]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:26 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating existing volume attachment record: a0db4ba8-fcbd-497a-b977-93775afeccf9 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:07:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Successfully created port: 2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Successfully updated port: 2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-changed-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Refreshing instance network info cache due to event network-changed-2e2b2970-2165-4e87-96f6-8e11994ff516. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance network_info: |[{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Refreshing network info cache for port 2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:07:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updated VIF entry in instance network info cache for port 2e2b2970-2165-4e87-96f6-8e11994ff516. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:07:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9003bfb-6659-48f4-8c8d-617c2eae1e3e req-53fd3546-e291-44dd-b43d-b28659419d10 service nova] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:32 user nova-compute[74903]: INFO nova.compute.manager [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Unshelving
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:07:32 user nova-compute[74903]: INFO nova.virt.block_device [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Booting with volume 1b89cecf-83ad-413d-ad2c-db8205ab62a9 at /dev/vda
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.utils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee35a6fa-acb2-4b41-b08d-6d645b1cde10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:07:32 user nova-compute[74903]: INFO nova.compute.claims [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Claim successful on node user
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[437340c6-fc14-42b7-b4cb-8b6b240feedb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b6211a-3670-4816-b269-60d4c7fbb5b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb09297-1a2b-4918-95ae-81e15258eb82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:07:32 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:07:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75338a1-0ed9-40f9-9672-8eb4cc1e8c34]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG os_brick.utils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:32 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating existing volume attachment record: 91ee764d-bea6-4948-81ab-9236cbc9101b {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:07:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.policy [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d10322732ce4e93b049be06ad946cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af82cdc03f0241bb8de82b8fb9d7a66c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:07:33 user nova-compute[74903]: INFO nova.virt.block_device [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Booting with volume-backed-image e8f85acc-7dce-4172-bf4e-a640a545c91b at /dev/vda
Nov 06 06:07:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Successfully created port: ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Successfully updated port: ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-changed-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Refreshing instance network info cache due to event network-changed-ae056fd7-a484-4ed4-b25f-8671ed4df9b6. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] Acquiring lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating instance_info_cache with network_info: [{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance network_info: |[{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] Acquired lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:07:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Refreshing network info cache for port ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:07:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updated VIF entry in instance network info cache for port ae056fd7-a484-4ed4-b25f-8671ed4df9b6. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:07:35 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating instance_info_cache with network_info: [{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:07:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c33734b-09e9-4915-b463-16b61e533511 req-8825a77a-2c34-4b9d-860f-203ae912e41a service nova] Releasing lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:07:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHcNEKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:39 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:39 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:39 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a709ff49-d441-4feb-b6aa-8e037e3ad594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:07:39 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48d376f-6f79-4ce2-bbf8-aaebd2ff5dad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496] added
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a66847-840b-4f72-a19b-09ff65635330]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e295e53-45ce-494b-b2b2-eed502f0ce20]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHcNEKeo {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHcNEKeo" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26453e3-6f99-47ce-8bc4-098431fbcde0]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHcNEKeo'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77316b5-22f8-484d-b9c7-2f59cf8b2ee2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ffce73-a04f-43d9-94e0-5defa07ec6c7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[421547af-3ede-4e30-ad06-352434ce0d8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260]
Nov 06 06:07:39 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260] successful.
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ca30a6-b1ff-4847-84bc-01c22fe4ba69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[936217df-a5d2-4666-9c9f-5abd1ee63097]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:39 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:39 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f845b62-f93b-4c36-9f08-821cd98386c2]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:07:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHcNEKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:07:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:40 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23330663261353465', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330663261353465', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:07:40 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:07:40 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:07:40 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:07:40 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:07:40 user nova-compute[74903]:   <serial>1cd08391-8348-4601-b855-d8696dc6a496</serial>
Nov 06 06:07:40 user nova-compute[74903]: </disk>
Nov 06 06:07:40 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] No VIF found with MAC fa:16:3e:ea:7e:f6, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d0fd54ee-5ae7-4652-89e4-e9fefb42975b tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.254s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:07:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Creating image(s)
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Ensure instance console log exists: /opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start _get_guest_xml network_info=[{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c907ba0f-9dd8-494a-846d-13758db2fabc', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'serial': 'cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a0db4ba8-fcbd-497a-b977-93775afeccf9', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:07:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:07:53 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:53 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:07:53 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffd81a2-1e02-4194-885f-bbae35cf1f81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:07:53 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d1a2b-09a8-43ac-8417-d97a3e7f94e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b] added
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890a9d8-cf73-4454-b86c-9de67786fb34]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5d1fc-8a06-4d2a-a810-55f6a0041b89]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEOcPlox {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEOcPlox" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[206549cc-3436-40c6-95e0-eb34730c4517]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEOcPlox'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d11c76-c288-44d8-8c81-54a1f615b7bb]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[81087de5-b3d5-410d-ab1f-0e9f78ed8294]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb952d2-3f42-4f62-9bf8-e8363d2738bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]
Nov 06 06:07:53 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e8f42-a2ac-4530-8c7b-a89907a75450]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4e275e-4b32-4502-b68d-245f72a9908e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:07:53 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:07:53 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[92642309-d607-409a-96fa-c8a35419b4b9]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:07:53 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23561383064616632', 'path': '/dev/sdh'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561383064616632', 'path': '/dev/sdh'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'pci_devices' on Instance uuid c907ba0f-9dd8-494a-846d-13758db2fabc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:07:54 user nova-compute[74903]:   <uuid>c907ba0f-9dd8-494a-846d-13758db2fabc</uuid>
Nov 06 06:07:54 user nova-compute[74903]:   <name>instance-0000001b</name>
Nov 06 06:07:54 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:07:54 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:07:54 user nova-compute[74903]:   <metadata>
Nov 06 06:07:54 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:07:54 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:07:54 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherA-server-217797069</nova:name>
Nov 06 06:07:54 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:07:53</nova:creationTime>
Nov 06 06:07:54 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:07:54 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:07:54 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:07:54 user nova-compute[74903]:       <nova:owner>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:user uuid="44c3df905516436e8a6c39e0f32a2e4b">tempest-ServerActionsTestOtherA-851074598-project-member</nova:user>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:project uuid="29b574412f0d4156a9d4538b17b2c163">tempest-ServerActionsTestOtherA-851074598</nova:project>
Nov 06 06:07:54 user nova-compute[74903]:       </nova:owner>
Nov 06 06:07:54 user nova-compute[74903]:       <nova:ports>
Nov 06 06:07:54 user nova-compute[74903]:         <nova:port uuid="2e2b2970-2165-4e87-96f6-8e11994ff516">
Nov 06 06:07:54 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 06:07:54 user nova-compute[74903]:         </nova:port>
Nov 06 06:07:54 user nova-compute[74903]:       </nova:ports>
Nov 06 06:07:54 user nova-compute[74903]:     </nova:instance>
Nov 06 06:07:54 user nova-compute[74903]:   </metadata>
Nov 06 06:07:54 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:07:54 user nova-compute[74903]:     <system>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="serial">c907ba0f-9dd8-494a-846d-13758db2fabc</entry>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="uuid">c907ba0f-9dd8-494a-846d-13758db2fabc</entry>
Nov 06 06:07:54 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:07:54 user nova-compute[74903]:     </system>
Nov 06 06:07:54 user nova-compute[74903]:   </sysinfo>
Nov 06 06:07:54 user nova-compute[74903]:   <os>
Nov 06 06:07:54 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:07:54 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:07:54 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:07:54 user nova-compute[74903]:   </os>
Nov 06 06:07:54 user nova-compute[74903]:   <features>
Nov 06 06:07:54 user nova-compute[74903]:     <acpi/>
Nov 06 06:07:54 user nova-compute[74903]:     <apic/>
Nov 06 06:07:54 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:07:54 user nova-compute[74903]:   </features>
Nov 06 06:07:54 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:07:54 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:07:54 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:07:54 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:07:54 user nova-compute[74903]:   </clock>
Nov 06 06:07:54 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:07:54 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:07:54 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:07:54 user nova-compute[74903]:   </cpu>
Nov 06 06:07:54 user nova-compute[74903]:   <devices>
Nov 06 06:07:54 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:07:54 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:07:54 user nova-compute[74903]:       <source dev="/dev/sdh"/>
Nov 06 06:07:54 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:07:54 user nova-compute[74903]:       <serial>cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b</serial>
Nov 06 06:07:54 user nova-compute[74903]:     </disk>
Nov 06 06:07:54 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:07:54 user nova-compute[74903]:       <mac address="fa:16:3e:b2:47:78"/>
Nov 06 06:07:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:54 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:07:54 user nova-compute[74903]:       <target dev="tap2e2b2970-21"/>
Nov 06 06:07:54 user nova-compute[74903]:     </interface>
Nov 06 06:07:54 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:07:54 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc/console.log" append="off"/>
Nov 06 06:07:54 user nova-compute[74903]:     </serial>
Nov 06 06:07:54 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:07:54 user nova-compute[74903]:     <video>
Nov 06 06:07:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:07:54 user nova-compute[74903]:     </video>
Nov 06 06:07:54 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:07:54 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:07:54 user nova-compute[74903]:     </rng>
Nov 06 06:07:54 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:07:54 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:07:54 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:07:54 user nova-compute[74903]:     </memballoon>
Nov 06 06:07:54 user nova-compute[74903]:   </devices>
Nov 06 06:07:54 user nova-compute[74903]: </domain>
Nov 06 06:07:54 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG os_vif [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12198b76-0481-5909-b13b-b07dd1086441', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e2b2970-21, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e2b2970-21, col_values=(('qos', UUID('bfcedafb-c800-4bfd-b523-1a098cb934b9')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e2b2970-21, col_values=(('external_ids', {'iface-id': '2e2b2970-2165-4e87-96f6-8e11994ff516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:47:78', 'vm-uuid': 'c907ba0f-9dd8-494a-846d-13758db2fabc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:54 user nova-compute[74903]: INFO os_vif [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21')
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:07:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:b2:47:78, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:56 user nova-compute[74903]: WARNING nova.compute.manager [req-01951cee-8351-4cd5-bd40-a03d0862d5d5 req-a5b9c563-a849-4b53-996d-988a513bcded service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state building and task_state spawning.
Nov 06 06:07:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:07:58 user nova-compute[74903]: WARNING nova.compute.manager [req-3df38c4a-2601-4c5c-b652-a9b03b0ec7fc req-0dac7ab9-82e2-4bb8-ad50-f70b35d9b300 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state building and task_state spawning.
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:07:58 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance spawned successfully.
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:07:58 user nova-compute[74903]: INFO nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 06 06:07:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:07:58 user nova-compute[74903]: INFO nova.compute.manager [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Took 33.23 seconds to build instance.
Nov 06 06:07:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07cd1e9c-5b84-4e54-a10f-70ad47a8db24 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.345s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:07:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.utils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2110c26-5e20-4f2c-8c20-dc2bf4ea0b7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba4e267-d212-46f2-a937-29dd752c559b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f4420-e4ed-4d60-83ee-cf8540bd9698]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[915eeab6-4cc2-4a76-a7e0-228e1584df5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:08:00 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:08:00 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[934bad66-4b62-4ec1-b9bd-5ad97a463ee1]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG os_brick.utils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:00 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating existing volume attachment record: a624485f-ca9b-497c-9d12-5a80d6921e2d {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:08:01 user nova-compute[74903]: INFO nova.compute.manager [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Unrescuing
Nov 06 06:08:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'flavor' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:02 user nova-compute[74903]: WARNING nova.compute.manager [req-e6976e92-c695-49f1-8d90-fb98cc950386 req-2dc9aabb-13e3-4a99-a038-7071fe833b38 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:08:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance destroyed successfully.
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:04 user nova-compute[74903]: WARNING nova.compute.manager [req-c2e9f0f9-0268-4783-9e21-d4f0044e7aa2 req-9879c17f-c4ab-451f-9ffa-b0679f28b355 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:06 user nova-compute[74903]: WARNING nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:08:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:06 user nova-compute[74903]: WARNING nova.compute.manager [req-f739c684-dbe8-42f3-8a1d-72d46957b885 req-68c8c411-2e1a-4e82-80de-8dcf5fe9aa39 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:08:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-81be756c-bdd7-4f78-bda0-b0f5a70013f3 tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:08:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:08:11 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating instance_info_cache with network_info: [{"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-8239a418-b65a-4d4f-95dd-efe0e836403a" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:08:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:08:18 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:08:19 user nova-compute[74903]: INFO nova.compute.claims [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Claim successful on node user
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.949s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:08:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.policy [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a284ec2f23734152a20aeb9658e08f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a48326e9015488594cdc613e41c7737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:08:21 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Creating image(s)
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "/opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "/opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "/opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.262s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk 1073741824" returned: 0 in 0.052s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Successfully created port: 027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Cannot resize image /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Successfully updated port: 027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquired lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-changed-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Refreshing instance network info cache due to event network-changed-027a8450-74fc-47bc-a736-5e446e737bd3. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] Acquiring lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Releasing lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Instance network_info: |[{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] Acquired lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.neutron [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Refreshing network info cache for port 027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Start _get_guest_xml network_info=[{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:08:23 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:23 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-823018447',display_name='tempest-VolumesAdminNegativeTest-server-823018447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-823018447',id=29,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuS+1Ys/XmhLwrST+A7ynDQl815K0Nc/tAOGQG4gLlagc31rTjI3fwgJECG2ITcsIbTPzRo0/w7MBqAPmkSc5DMG4Vj/Xy0NvuY2GA56OZV8RgL2H/+4eR+/LHoeUEsFw==',key_name='tempest-keypair-1641403369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-hvmh0ba0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=33a299c1-0d52-464c-8ca9-b3fd49f43ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'pci_devices' on Instance uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:08:23 user nova-compute[74903]:   <uuid>33a299c1-0d52-464c-8ca9-b3fd49f43ef7</uuid>
Nov 06 06:08:23 user nova-compute[74903]:   <name>instance-0000001d</name>
Nov 06 06:08:23 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:08:23 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:08:23 user nova-compute[74903]:   <metadata>
Nov 06 06:08:23 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:08:23 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:name>tempest-VolumesAdminNegativeTest-server-823018447</nova:name>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:08:23</nova:creationTime>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:08:23 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:08:23 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:owner>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:user uuid="a284ec2f23734152a20aeb9658e08f5c">tempest-VolumesAdminNegativeTest-55869565-project-member</nova:user>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:project uuid="2a48326e9015488594cdc613e41c7737">tempest-VolumesAdminNegativeTest-55869565</nova:project>
Nov 06 06:08:23 user nova-compute[74903]:       </nova:owner>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:08:23 user nova-compute[74903]:       <nova:ports>
Nov 06 06:08:23 user nova-compute[74903]:         <nova:port uuid="027a8450-74fc-47bc-a736-5e446e737bd3">
Nov 06 06:08:23 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:08:23 user nova-compute[74903]:         </nova:port>
Nov 06 06:08:23 user nova-compute[74903]:       </nova:ports>
Nov 06 06:08:23 user nova-compute[74903]:     </nova:instance>
Nov 06 06:08:23 user nova-compute[74903]:   </metadata>
Nov 06 06:08:23 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:08:23 user nova-compute[74903]:     <system>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="serial">33a299c1-0d52-464c-8ca9-b3fd49f43ef7</entry>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="uuid">33a299c1-0d52-464c-8ca9-b3fd49f43ef7</entry>
Nov 06 06:08:23 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:08:23 user nova-compute[74903]:     </system>
Nov 06 06:08:23 user nova-compute[74903]:   </sysinfo>
Nov 06 06:08:23 user nova-compute[74903]:   <os>
Nov 06 06:08:23 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:08:23 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:08:23 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:08:23 user nova-compute[74903]:   </os>
Nov 06 06:08:23 user nova-compute[74903]:   <features>
Nov 06 06:08:23 user nova-compute[74903]:     <acpi/>
Nov 06 06:08:23 user nova-compute[74903]:     <apic/>
Nov 06 06:08:23 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:08:23 user nova-compute[74903]:   </features>
Nov 06 06:08:23 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:08:23 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:08:23 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:08:23 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:08:23 user nova-compute[74903]:   </clock>
Nov 06 06:08:23 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:08:23 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:08:23 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:08:23 user nova-compute[74903]:   </cpu>
Nov 06 06:08:23 user nova-compute[74903]:   <devices>
Nov 06 06:08:23 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:08:23 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:08:23 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk"/>
Nov 06 06:08:23 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:08:23 user nova-compute[74903]:     </disk>
Nov 06 06:08:23 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:08:23 user nova-compute[74903]:       <mac address="fa:16:3e:ed:eb:27"/>
Nov 06 06:08:23 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:23 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:08:23 user nova-compute[74903]:       <target dev="tap027a8450-74"/>
Nov 06 06:08:23 user nova-compute[74903]:     </interface>
Nov 06 06:08:23 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:08:23 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/console.log" append="off"/>
Nov 06 06:08:23 user nova-compute[74903]:     </serial>
Nov 06 06:08:23 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:08:23 user nova-compute[74903]:     <video>
Nov 06 06:08:23 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:23 user nova-compute[74903]:     </video>
Nov 06 06:08:23 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:08:23 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:08:23 user nova-compute[74903]:     </rng>
Nov 06 06:08:23 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:08:23 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:08:23 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:08:23 user nova-compute[74903]:     </memballoon>
Nov 06 06:08:23 user nova-compute[74903]:   </devices>
Nov 06 06:08:23 user nova-compute[74903]: </domain>
Nov 06 06:08:23 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-823018447',display_name='tempest-VolumesAdminNegativeTest-server-823018447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-823018447',id=29,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuS+1Ys/XmhLwrST+A7ynDQl815K0Nc/tAOGQG4gLlagc31rTjI3fwgJECG2ITcsIbTPzRo0/w7MBqAPmkSc5DMG4Vj/Xy0NvuY2GA56OZV8RgL2H/+4eR+/LHoeUEsFw==',key_name='tempest-keypair-1641403369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-hvmh0ba0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=33a299c1-0d52-464c-8ca9-b3fd49f43ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG os_vif [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a875b94-611d-560e-a551-9fa98dff6f9f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027a8450-74, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap027a8450-74, col_values=(('qos', UUID('ca66e0f9-9d97-4d82-a5ab-99b2c360a345')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap027a8450-74, col_values=(('external_ids', {'iface-id': '027a8450-74fc-47bc-a736-5e446e737bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:eb:27', 'vm-uuid': '33a299c1-0d52-464c-8ca9-b3fd49f43ef7'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:23 user nova-compute[74903]: INFO os_vif [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74')
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No VIF found with MAC fa:16:3e:ed:eb:27, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updated VIF entry in instance network info cache for port 027a8450-74fc-47bc-a736-5e446e737bd3. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4faccd84-3fd6-4a29-ad5b-9c4be89f242f req-f74a8ef3-0b9f-412f-a1e7-1ccb911d4f3b service nova] Releasing lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] No waiting events found dispatching network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:28 user nova-compute[74903]: WARNING nova.compute.manager [req-5da77015-cd2c-4008-8beb-5913292c458b req-cd7a14c2-f313-4b79-adbe-c37fc75a3d0e service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received unexpected event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 for instance with vm_state building and task_state spawning.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] No waiting events found dispatching network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:28 user nova-compute[74903]: WARNING nova.compute.manager [req-3a519d0d-9e7f-4bbc-b9c6-41363627f140 req-05ac6a9e-7c05-41f0-a349-19d4dda6ea36 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received unexpected event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 for instance with vm_state building and task_state spawning.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:08:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7107MB free_disk=25.120880126953125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Instance spawned successfully.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:28 user nova-compute[74903]: INFO nova.compute.manager [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Terminating instance
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: INFO nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Applying migration context for instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 as it has an incoming, in-progress migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6. Migration status is reverting {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 06:08:28 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating resource usage from migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 673648d8-b84a-43ff-8e2b-e52702a198be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 01eff73b-21e7-4cdb-bffe-973d3e13c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 6a685cae-989a-473d-80b9-ded3974de38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Port bd470b96-807a-4d77-8af1-362676fa3552 binding to destination host user is already ACTIVE {{(pid=74903) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:08:28 user nova-compute[74903]: INFO nova.compute.manager [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Took 9.10 seconds to build instance.
Nov 06 06:08:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8ce6430d-073c-4b11-9ef9-07ebbf37f977 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.254s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Instance destroyed successfully.
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lazy-loading 'resources' on Instance uuid 01eff73b-21e7-4cdb-bffe-973d3e13c6e0 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1761149164',display_name='tempest-VolumesActionsTest-instance-1761149164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1761149164',id=26,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0407911ca4ad4d06a00c04da2a5b121c',ramdisk_id='',reservation_id='r-177ai0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1503865399',owner_user_name='tempest-VolumesActionsTest-1503865399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:06:43Z,user_data=None,user_id='d524e206cbd74470ac85aaad34748925',uuid=01eff73b-21e7-4cdb-bffe-973d3e13c6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converting VIF {"id": "f7e673b9-383b-490a-93eb-a678271f9171", "address": "fa:16:3e:2d:07:89", "network": {"id": "14c04a73-8456-4041-8326-675bd725351c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-424630702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0407911ca4ad4d06a00c04da2a5b121c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e673b9-38", "ovs_interfaceid": "f7e673b9-383b-490a-93eb-a678271f9171", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG os_vif [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7e673b9-38, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=340793f5-5762-437d-b1c4-fc9cf0044fa1) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: INFO os_vif [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:07:89,bridge_name='br-int',has_traffic_filtering=True,id=f7e673b9-383b-490a-93eb-a678271f9171,network=Network(14c04a73-8456-4041-8326-675bd725351c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e673b9-38')
Nov 06 06:08:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Deleting instance files /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0_del
Nov 06 06:08:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Deletion of /opt/stack/data/nova/instances/01eff73b-21e7-4cdb-bffe-973d3e13c6e0_del complete
Nov 06 06:08:29 user nova-compute[74903]: INFO nova.compute.manager [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Creating tmpfile /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/tmp72d00t3p to verify with other compute node that the instance is on the same shared storage. {{(pid=74903) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.132s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.995s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'pci_requests' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'numa_topology' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:08:29 user nova-compute[74903]: INFO nova.compute.claims [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Claim successful on node user
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-unplugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] No waiting events found dispatching network-vif-unplugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-unplugged-f7e673b9-383b-490a-93eb-a678271f9171 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Acquiring lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] No waiting events found dispatching network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:29 user nova-compute[74903]: WARNING nova.compute.manager [req-689b629e-151b-46bb-8bce-8b4b3aafdbf2 req-30166dcc-92dd-492d-9b04-97acc79dfc57 service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received unexpected event network-vif-plugged-f7e673b9-383b-490a-93eb-a678271f9171 for instance with vm_state active and task_state deleting.
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:08:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Creating image(s)
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Ensure instance console log exists: /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start _get_guest_xml network_info=[{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f07c272e-7eb5-485a-8ad7-c15b9a1be2c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccbf57d7-2345-4449-b851-8eaac2bff222', 'serial': 'ccbf57d7-2345-4449-b851-8eaac2bff222'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a624485f-ca9b-497c-9d12-5a80d6921e2d', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:08:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:30 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a6ede-7d5c-481e-a26d-fc738e3d2f08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:08:30 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[019d5c98-3d42-4062-bd3f-f49b13a896d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:30 user nova-compute[74903]: WARNING nova.compute.manager [req-3118d882-5525-48ca-8829-f7bbc25c689c req-c5ffe0d7-9573-4091-bd45-2eab4fc81823 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state resized and task_state resize_reverting.
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222] added
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:08:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance destroyed successfully.
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'resources' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6525f560-131a-46a2-89a0-7b74137b7dc8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd470b96-80, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=687097c1-4673-4f3f-ab0b-74df850decc6) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:30 user nova-compute[74903]: INFO os_vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79102bc5-10b5-4997-8ca4-2e3520b935f2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnYEKWTv {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnYEKWTv" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d3bb4-0d85-42e4-9359-8c4dfd00b436]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZnYEKWTv'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7cd3b0-a0a2-4d5a-b431-01288b8d2d3a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Took 1.38 seconds to deallocate network for instance.
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea48599b-2537-44fd-9428-8d4af910fbb8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587b5d0-314d-4ae0-ab3e-99fc9cbc18fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260]
Nov 06 06:08:30 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260] successful.
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ee95f-946c-4cf5-aadb-eaefda6fd4f5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[479564db-d6f8-4f50-a84e-5d586886baf4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:30 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.804s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] HCTL ('41', '-', '-', 0) found on session 29 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.387s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.125s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c723d-f7a4-4812-992d-a23899e296ed]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching for a device in session 29 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:08:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:08:31 user nova-compute[74903]: INFO nova.network.neutron [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating port b35081d0-53fc-4c39-a633-7ce512bfc52f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.738s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:31 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Deleted allocations for instance 01eff73b-21e7-4cdb-bffe-973d3e13c6e0
Nov 06 06:08:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad33d783-da10-43ab-a6fe-18e92b2e372a tempest-VolumesActionsTest-1503865399 tempest-VolumesActionsTest-1503865399-project-member] Lock "01eff73b-21e7-4cdb-bffe-973d3e13c6e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.397s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.854s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== connect_volume: return (1856ms) {'type': 'block', 'scsi_wwn': '23662653439326636', 'path': '/dev/sdj'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662653439326636', 'path': '/dev/sdj'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-117646916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-117646916',id=28,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-eefndi30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:07:33Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=f07c272e-7eb5-485a-8ad7-c15b9a1be2c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:08:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63f9e9-6ab8-45c1-b108-b680b3990720]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:08:32 user nova-compute[74903]: No targets found.
Nov 06 06:08:32 user nova-compute[74903]: iSNS:
Nov 06 06:08:32 user nova-compute[74903]: No targets found.
Nov 06 06:08:32 user nova-compute[74903]: STATIC:
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:08:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:32 user nova-compute[74903]: FIRMWARE:
Nov 06 06:08:32 user nova-compute[74903]: No targets found.
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:08:32 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:08:32 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:08:32 user nova-compute[74903]:   <uuid>f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</uuid>
Nov 06 06:08:32 user nova-compute[74903]:   <name>instance-0000001c</name>
Nov 06 06:08:32 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:08:32 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:08:32 user nova-compute[74903]:   <metadata>
Nov 06 06:08:32 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:08:32 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-117646916</nova:name>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:08:30</nova:creationTime>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:08:32 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:08:32 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:owner>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 06:08:32 user nova-compute[74903]:       </nova:owner>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:08:32 user nova-compute[74903]:       <nova:ports>
Nov 06 06:08:32 user nova-compute[74903]:         <nova:port uuid="ae056fd7-a484-4ed4-b25f-8671ed4df9b6">
Nov 06 06:08:32 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 06:08:32 user nova-compute[74903]:         </nova:port>
Nov 06 06:08:32 user nova-compute[74903]:       </nova:ports>
Nov 06 06:08:32 user nova-compute[74903]:     </nova:instance>
Nov 06 06:08:32 user nova-compute[74903]:   </metadata>
Nov 06 06:08:32 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:08:32 user nova-compute[74903]:     <system>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="serial">f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</entry>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="uuid">f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</entry>
Nov 06 06:08:32 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:08:32 user nova-compute[74903]:     </system>
Nov 06 06:08:32 user nova-compute[74903]:   </sysinfo>
Nov 06 06:08:32 user nova-compute[74903]:   <os>
Nov 06 06:08:32 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:08:32 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:08:32 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:08:32 user nova-compute[74903]:   </os>
Nov 06 06:08:32 user nova-compute[74903]:   <features>
Nov 06 06:08:32 user nova-compute[74903]:     <acpi/>
Nov 06 06:08:32 user nova-compute[74903]:     <apic/>
Nov 06 06:08:32 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:08:32 user nova-compute[74903]:   </features>
Nov 06 06:08:32 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:08:32 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:08:32 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:08:32 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:08:32 user nova-compute[74903]:   </clock>
Nov 06 06:08:32 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:08:32 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:08:32 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:08:32 user nova-compute[74903]:   </cpu>
Nov 06 06:08:32 user nova-compute[74903]:   <devices>
Nov 06 06:08:32 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:08:32 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:32 user nova-compute[74903]:       <source dev="/dev/sdj"/>
Nov 06 06:08:32 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:08:32 user nova-compute[74903]:       <serial>ccbf57d7-2345-4449-b851-8eaac2bff222</serial>
Nov 06 06:08:32 user nova-compute[74903]:     </disk>
Nov 06 06:08:32 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:08:32 user nova-compute[74903]:       <mac address="fa:16:3e:89:db:1a"/>
Nov 06 06:08:32 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:32 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:08:32 user nova-compute[74903]:       <target dev="tapae056fd7-a4"/>
Nov 06 06:08:32 user nova-compute[74903]:     </interface>
Nov 06 06:08:32 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:08:32 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/console.log" append="off"/>
Nov 06 06:08:32 user nova-compute[74903]:     </serial>
Nov 06 06:08:32 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:08:32 user nova-compute[74903]:     <video>
Nov 06 06:08:32 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:32 user nova-compute[74903]:     </video>
Nov 06 06:08:32 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:08:32 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:08:32 user nova-compute[74903]:     </rng>
Nov 06 06:08:32 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:08:32 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:08:32 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:08:32 user nova-compute[74903]:     </memballoon>
Nov 06 06:08:32 user nova-compute[74903]:   </devices>
Nov 06 06:08:32 user nova-compute[74903]: </domain>
Nov 06 06:08:32 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-117646916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-117646916',id=28,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-eefndi30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:07:33Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=f07c272e-7eb5-485a-8ad7-c15b9a1be2c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_vif [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1e91274-1a4e-5176-bed7-f07a9ee7adf7', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e278d7-f88a-4ced-a229-943de42c2108]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae056fd7-a4, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae056fd7-a4, col_values=(('qos', UUID('b01257ac-c3ef-4373-9ae6-6ca2c6f7a8f8')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae056fd7-a4, col_values=(('external_ids', {'iface-id': 'ae056fd7-a484-4ed4-b25f-8671ed4df9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:db:1a', 'vm-uuid': 'f07c272e-7eb5-485a-8ad7-c15b9a1be2c1'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:32 user nova-compute[74903]: INFO os_vif [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4')
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d66f385-6bc3-4b68-a8ba-20a51492d60d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa2846a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc108931-c2cb-4384-96f9-66646117839c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0d321-3c1b-424e-9589-9125504b6818]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebef0c19-19dd-4476-bc22-af7f3eb76db1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:89:db:1a, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035dbea-7198-4d88-918c-d1fc339f649a]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390889f-7c97-4c0e-aa49-4900f150d181]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:32 user nova-compute[74903]: WARNING nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state resized and task_state resize_reverting.
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: 01eff73b-21e7-4cdb-bffe-973d3e13c6e0] Received event network-vif-deleted-f7e673b9-383b-490a-93eb-a678271f9171 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing instance network info cache due to event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7cc2c0-77e8-4a3b-99b3-8e305abc35db]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:08:32 user nova-compute[74903]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff100e4-4bd8-48ad-be79-1e869d521a98]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== disconnect_volume: return (1834ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:08:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Creating image(s)
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Ensure instance console log exists: /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start _get_guest_xml network_info=[{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4c9a4d3-6553-48f6-85b1-00d9c905cc50', 'attached_at': '', 'detached_at': '', 'volume_id': '1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'serial': '1b89cecf-83ad-413d-ad2c-db8205ab62a9'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '91ee764d-bea6-4948-81ab-9236cbc9101b', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:08:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.objects.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Object Instance<c4c9a4d3-6553-48f6-85b1-00d9c905cc50> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:32 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[428d1bb2-44f7-46f3-9af9-e7c6cdb9e291]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:08:32 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[549646a4-72f8-4392-a7a0-efda90552be6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9] added
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec051c-5983-4671-b251-7786d7c7cb35]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac50fc-e57f-4dc4-918c-f69238fe7bcc]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWzdIsUr {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWzdIsUr" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b65ba4-2e41-40f6-8e54-3a3e68a05487]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWzdIsUr'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7a66fa-d43b-4f81-9f0b-97b64e5cff2b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d4ce0a-d835-4215-922a-f0e3a4e7cbd8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:32 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[57764fd0-8725-4d32-a1c3-d4db8494c22a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]
Nov 06 06:08:33 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.
Nov 06 06:08:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[52001625-c9f4-422b-a93a-fbee6bda09dd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec0509-dbda-424d-9ad5-255e15792939]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:822a62d5-751f-419b-828d-63d8503af756 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:08:33 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c3933-939c-43c4-b617-be23db63607f]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updated VIF entry in instance network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4aabf1f8-8e71-43af-b8d5-9c28fb832c5d req-603e560a-9771-4681-a872-7b5f3dae63fc service nova] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'migration_context' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.objects.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Object Instance<3cff20f3-7370-43ad-a050-1cbd107aaf52> lazy-loaded attributes: resources,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26266343930346535', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266343930346535', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2063912077',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:07:32Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'pci_devices' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.objects.base [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Object Instance<c4c9a4d3-6553-48f6-85b1-00d9c905cc50> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:08:34 user nova-compute[74903]:   <uuid>c4c9a4d3-6553-48f6-85b1-00d9c905cc50</uuid>
Nov 06 06:08:34 user nova-compute[74903]:   <name>instance-00000015</name>
Nov 06 06:08:34 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:08:34 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:08:34 user nova-compute[74903]:   <metadata>
Nov 06 06:08:34 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:08:34 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:08:34 user nova-compute[74903]:       <nova:name>tempest-TestShelveInstance-server-865305500</nova:name>
Nov 06 06:08:34 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:08:32</nova:creationTime>
Nov 06 06:08:34 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:08:34 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:08:34 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:08:34 user nova-compute[74903]:       <nova:owner>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:user uuid="9f23b6ac95ae4183a9f74b1927407f2e">tempest-TestShelveInstance-1152944910-project-member</nova:user>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:project uuid="90ac1d35737f4599bfc799afb620174c">tempest-TestShelveInstance-1152944910</nova:project>
Nov 06 06:08:34 user nova-compute[74903]:       </nova:owner>
Nov 06 06:08:34 user nova-compute[74903]:       <nova:ports>
Nov 06 06:08:34 user nova-compute[74903]:         <nova:port uuid="b35081d0-53fc-4c39-a633-7ce512bfc52f">
Nov 06 06:08:34 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 06:08:34 user nova-compute[74903]:         </nova:port>
Nov 06 06:08:34 user nova-compute[74903]:       </nova:ports>
Nov 06 06:08:34 user nova-compute[74903]:     </nova:instance>
Nov 06 06:08:34 user nova-compute[74903]:   </metadata>
Nov 06 06:08:34 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:08:34 user nova-compute[74903]:     <system>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="serial">c4c9a4d3-6553-48f6-85b1-00d9c905cc50</entry>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="uuid">c4c9a4d3-6553-48f6-85b1-00d9c905cc50</entry>
Nov 06 06:08:34 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:08:34 user nova-compute[74903]:     </system>
Nov 06 06:08:34 user nova-compute[74903]:   </sysinfo>
Nov 06 06:08:34 user nova-compute[74903]:   <os>
Nov 06 06:08:34 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:08:34 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:08:34 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:08:34 user nova-compute[74903]:   </os>
Nov 06 06:08:34 user nova-compute[74903]:   <features>
Nov 06 06:08:34 user nova-compute[74903]:     <acpi/>
Nov 06 06:08:34 user nova-compute[74903]:     <apic/>
Nov 06 06:08:34 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:08:34 user nova-compute[74903]:   </features>
Nov 06 06:08:34 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:08:34 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:08:34 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:08:34 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:08:34 user nova-compute[74903]:   </clock>
Nov 06 06:08:34 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:08:34 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:08:34 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:08:34 user nova-compute[74903]:   </cpu>
Nov 06 06:08:34 user nova-compute[74903]:   <devices>
Nov 06 06:08:34 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:08:34 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:34 user nova-compute[74903]:       <source dev="/dev/sdd"/>
Nov 06 06:08:34 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:08:34 user nova-compute[74903]:       <serial>1b89cecf-83ad-413d-ad2c-db8205ab62a9</serial>
Nov 06 06:08:34 user nova-compute[74903]:     </disk>
Nov 06 06:08:34 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:08:34 user nova-compute[74903]:       <mac address="fa:16:3e:77:da:2c"/>
Nov 06 06:08:34 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:34 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:08:34 user nova-compute[74903]:       <target dev="tapb35081d0-53"/>
Nov 06 06:08:34 user nova-compute[74903]:     </interface>
Nov 06 06:08:34 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:08:34 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50/console.log" append="off"/>
Nov 06 06:08:34 user nova-compute[74903]:     </serial>
Nov 06 06:08:34 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:08:34 user nova-compute[74903]:     <video>
Nov 06 06:08:34 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:08:34 user nova-compute[74903]:     </video>
Nov 06 06:08:34 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:08:34 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:08:34 user nova-compute[74903]:     </rng>
Nov 06 06:08:34 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:08:34 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:08:34 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:08:34 user nova-compute[74903]:     </memballoon>
Nov 06 06:08:34 user nova-compute[74903]:   </devices>
Nov 06 06:08:34 user nova-compute[74903]: </domain>
Nov 06 06:08:34 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2063912077',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:07:32Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG os_vif [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c13a7786-2f80-55a1-bc9d-128b99a7d536', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb35081d0-53, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb35081d0-53, col_values=(('qos', UUID('9d359153-cdfa-4a85-aa37-a7e351e48f29')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb35081d0-53, col_values=(('external_ids', {'iface-id': 'b35081d0-53fc-4c39-a633-7ce512bfc52f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:da:2c', 'vm-uuid': 'c4c9a4d3-6553-48f6-85b1-00d9c905cc50'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:34 user nova-compute[74903]: INFO os_vif [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53')
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:34 user nova-compute[74903]: WARNING nova.compute.manager [req-d64826f4-869c-4fd3-b428-8db34aa32801 req-5450f1b4-7bc0-4653-8f66-82a5dcba004a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state building and task_state spawning.
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] No VIF found with MAC fa:16:3e:77:da:2c, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:08:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:08:35 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:08:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.131s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:35 user nova-compute[74903]: INFO nova.compute.manager [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Swapping old allocation on dict_keys(['ff4fb787-d54c-4cc6-9e4b-13f1ebe11772']) held by migration 2c54769d-d371-42e8-a5cb-45cc5858c5f6 for instance
Nov 06 06:08:35 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Overwriting current allocation {'allocations': {'ff4fb787-d54c-4cc6-9e4b-13f1ebe11772': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': 'fd56e3653ea34efcab24bd58a8b2d6d8', 'user_id': '5380e1aa9f6c43dda84e1528cb964a55', 'consumer_generation': 1} on consumer 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 06 06:08:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:08:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquired lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:08:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:36 user nova-compute[74903]: WARNING nova.compute.manager [req-490de54b-6ba5-4f1e-9f1a-feb9f2805ba3 req-8bf53a89-cb34-493f-902f-84bcda6f3930 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state building and task_state spawning.
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:08:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance spawned successfully.
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: INFO nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Releasing lock "refresh_cache-3cff20f3-7370-43ad-a050-1cbd107aaf52" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG os_brick.utils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f428c-663c-4b00-b6ce-449bb689d601]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:37 user nova-compute[74903]: INFO nova.compute.manager [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Took 64.60 seconds to build instance.
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d143732-7a2e-428a-be2e-0ab01f0990df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84bbb6d5-4f0b-411a-a1e7-25eb945c1c32 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 64.738s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7585f3-71dd-4786-bcaa-5d4cc24d2caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5f097-5b76-47a4-9417-8350ab543e03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:08:37 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:08:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[30606141-f4b4-47c7-a497-9465e2d82c80]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:08:37 user nova-compute[74903]: DEBUG os_brick.utils [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:38 user nova-compute[74903]: INFO nova.compute.manager [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Detaching volume 6a08b890-5548-44b9-b510-29668799b6b3
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:38 user nova-compute[74903]: WARNING nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:08:38 user nova-compute[74903]: WARNING nova.compute.manager [req-33f0eae7-4ac2-44b7-ad0c-141ba012184b req-32e0a745-ce8f-478c-95d1-266f97b488c1 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:08:38 user nova-compute[74903]: INFO nova.virt.block_device [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Attempting to driver detach volume 6a08b890-5548-44b9-b510-29668799b6b3 from mountpoint /dev/vdc
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Attempting to detach device vdc from instance 6a685cae-989a-473d-80b9-ded3974de38c from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:08:38 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:38 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:08:38 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:08:38 user nova-compute[74903]:   <serial>6a08b890-5548-44b9-b510-29668799b6b3</serial>
Nov 06 06:08:38 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:08:38 user nova-compute[74903]: </disk>
Nov 06 06:08:38 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:08:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully detached device vdc from instance 6a685cae-989a-473d-80b9-ded3974de38c from the persistent domain config.
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6a685cae-989a-473d-80b9-ded3974de38c from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:08:38 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:38 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:08:38 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:08:38 user nova-compute[74903]:   <serial>6a08b890-5548-44b9-b510-29668799b6b3</serial>
Nov 06 06:08:38 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:08:38 user nova-compute[74903]: </disk>
Nov 06 06:08:38 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:08:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance spawned successfully.
Nov 06 06:08:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:08:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9e9e49a5-290c-4567-ae2d-88dabe518e69 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 66.739s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:08:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:08:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:08:45 user nova-compute[74903]: INFO nova.compute.manager [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Detaching volume 1cd08391-8348-4601-b855-d8696dc6a496
Nov 06 06:08:45 user nova-compute[74903]: INFO nova.virt.block_device [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Attempting to driver detach volume 1cd08391-8348-4601-b855-d8696dc6a496 from mountpoint /dev/vdb
Nov 06 06:08:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Attempting to detach device vdb from instance 673648d8-b84a-43ff-8e2b-e52702a198be from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:08:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:08:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:45 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:08:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:08:45 user nova-compute[74903]:   <serial>1cd08391-8348-4601-b855-d8696dc6a496</serial>
Nov 06 06:08:45 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:08:45 user nova-compute[74903]: </disk>
Nov 06 06:08:45 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:08:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully detached device vdb from instance 673648d8-b84a-43ff-8e2b-e52702a198be from the persistent domain config.
Nov 06 06:08:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 673648d8-b84a-43ff-8e2b-e52702a198be from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:08:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:08:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:08:45 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:08:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:08:45 user nova-compute[74903]:   <serial>1cd08391-8348-4601-b855-d8696dc6a496</serial>
Nov 06 06:08:45 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:08:45 user nova-compute[74903]: </disk>
Nov 06 06:08:45 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:08:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:08:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:08:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:08:59 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6a685cae-989a-473d-80b9-ded3974de38c is timed out.
Nov 06 06:08:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully detached device vdc from instance 6a685cae-989a-473d-80b9-ded3974de38c from the live domain config.
Nov 06 06:08:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWNyznJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:08:59 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf8cec-d0e2-4c6a-baf9-6652dd4b80cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:08:59 user nova-compute[74903]: No targets found.
Nov 06 06:08:59 user nova-compute[74903]: iSNS:
Nov 06 06:08:59 user nova-compute[74903]: No targets found.
Nov 06 06:08:59 user nova-compute[74903]: STATIC:
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:08:59 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:08:59 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:08:59 user nova-compute[74903]: FIRMWARE:
Nov 06 06:08:59 user nova-compute[74903]: No targets found.
Nov 06 06:08:59 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:08:59 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:08:59 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5355634c-34f3-40db-ab51-a21d9765f35b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b52642-7266-416e-8ed9-8506ff5e2b19]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:59 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:08:59 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:08:59 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa285d8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3'): ({'sde'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Removing single pathed devices sde {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f2270a-87b4-4233-8dd7-63b93e7dc545]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7de792-87d5-4974-a7b7-f1c811563ddf]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flushing IO for device /dev/sde {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[921a30bc-d2e5-44a8-b898-827bbd66a4a2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d69b5f-02e5-4cf3-9fd6-d72a13df10cb]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1cfc9-39f9-40e2-a04f-0fafe950eac9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[02878680-3a83-4359-9529-e60fc6fa9b4b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260]
Nov 06 06:08:59 user nova-compute[74903]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3, portal: 172.16.0.220,3260] successful.
Nov 06 06:08:59 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a08b890-5548-44b9-b510-29668799b6b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b292b53-c234-4797-8ea7-1c5db292d4e3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] <== disconnect_volume: return (416ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:08:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:09:00 user nova-compute[74903]: DEBUG nova.objects.instance [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'flavor' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:09:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf79beeb-a087-4094-a6fa-0fb38f1d8406 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.175s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:06 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 673648d8-b84a-43ff-8e2b-e52702a198be is timed out.
Nov 06 06:09:06 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully detached device vdb from instance 673648d8-b84a-43ff-8e2b-e52702a198be from the live domain config.
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHcNEKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:06 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f16295-1ffb-45ca-89c5-2a942a9852bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:09:06 user nova-compute[74903]: No targets found.
Nov 06 06:09:06 user nova-compute[74903]: iSNS:
Nov 06 06:09:06 user nova-compute[74903]: No targets found.
Nov 06 06:09:06 user nova-compute[74903]: STATIC:
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:09:06 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:06 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:06 user nova-compute[74903]: FIRMWARE:
Nov 06 06:09:06 user nova-compute[74903]: No targets found.
Nov 06 06:09:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:09:06 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:09:06 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b6ac51-11f4-463f-aa0a-18191721c024]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd1dc28-18b7-4683-b507-ba7c25eb96f3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:808117fd-9a62-4311-abc2-896e44e825ee (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:06 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087dc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf35144-5b21-47b5-bb3d-8859b73b48f0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e7256-7eea-4281-af56-d29af095944d]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a24f8c9-9d4e-428c-9783-be1fb66ed9ad]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[31795475-711a-4770-9990-74f9319d732f]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d9555a-3d09-48f1-be87-9654ab418bb5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e70ced-6f7a-416c-939b-6db476f39569]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260]
Nov 06 06:09:06 user nova-compute[74903]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496, portal: 172.16.0.220,3260] successful.
Nov 06 06:09:06 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba168244-9a4b-4b7d-93cf-3f50cdffbfac]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== disconnect_volume: return (398ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Starting finish_revert_migration {{(pid=74903) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start _get_guest_xml network_info=[{"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3cff20f3-7370-43ad-a050-1cbd107aaf52', 'attached_at': '2023-11-06T06:09:07.000000', 'detached_at': '', 'volume_id': 'bcd027d7-2a7e-4487-b862-ced289e35d79', 'serial': 'bcd027d7-2a7e-4487-b862-ced289e35d79'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '7e7df054-5e44-4fa0-836d-3c3ac49dd3c4', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:09:06 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:06 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:06 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:06 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:06 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be48832-bdb6-4a11-9643-e1154ba30031]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:09:06 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6482ee41-08a3-45bd-a68a-7fad818d4cf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79] added
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc69ca-953b-4eb7-af38-21e6ba50f6e0]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d814a93-e052-4cbd-8127-473ec6cb6828]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdBANyfC" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd6238-9e06-470f-9cf2-9c039a6efb93]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdBANyfC'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d49b67-6306-405c-8c56-265620ccd151]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3cf3fb-0fa1-45e2-9017-362a9e5e9c13]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2789947-55d7-430f-b17d-0dca996eb2a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:09:07 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e214a44-f93a-4a08-85a6-d8326650489a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[066adc1f-b29c-453a-ab75-5972954bb918]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:07 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[25480772-4612-45fb-995d-571cab40317c]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:09:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'flavor' on Instance uuid 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8035db93-6f87-45cd-88c4-c16369dcbf5f tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.819s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.640s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:08 user nova-compute[74903]: INFO nova.compute.manager [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Terminating instance
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sde'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730633963386366', 'path': '/dev/sde'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:09:08 user nova-compute[74903]:   <uuid>3cff20f3-7370-43ad-a050-1cbd107aaf52</uuid>
Nov 06 06:09:08 user nova-compute[74903]:   <name>instance-00000014</name>
Nov 06 06:09:08 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:09:08 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:09:08 user nova-compute[74903]:   <metadata>
Nov 06 06:09:08 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:09:08 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherB-server-1513746207</nova:name>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:09:06</nova:creationTime>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:09:08 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:09:08 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:owner>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:user uuid="5380e1aa9f6c43dda84e1528cb964a55">tempest-ServerActionsTestOtherB-325946081-project-member</nova:user>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:project uuid="fd56e3653ea34efcab24bd58a8b2d6d8">tempest-ServerActionsTestOtherB-325946081</nova:project>
Nov 06 06:09:08 user nova-compute[74903]:       </nova:owner>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:09:08 user nova-compute[74903]:       <nova:ports>
Nov 06 06:09:08 user nova-compute[74903]:         <nova:port uuid="bd470b96-807a-4d77-8af1-362676fa3552">
Nov 06 06:09:08 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:09:08 user nova-compute[74903]:         </nova:port>
Nov 06 06:09:08 user nova-compute[74903]:       </nova:ports>
Nov 06 06:09:08 user nova-compute[74903]:     </nova:instance>
Nov 06 06:09:08 user nova-compute[74903]:   </metadata>
Nov 06 06:09:08 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:09:08 user nova-compute[74903]:     <system>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="serial">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="uuid">3cff20f3-7370-43ad-a050-1cbd107aaf52</entry>
Nov 06 06:09:08 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:09:08 user nova-compute[74903]:     </system>
Nov 06 06:09:08 user nova-compute[74903]:   </sysinfo>
Nov 06 06:09:08 user nova-compute[74903]:   <os>
Nov 06 06:09:08 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:09:08 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:09:08 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:09:08 user nova-compute[74903]:   </os>
Nov 06 06:09:08 user nova-compute[74903]:   <features>
Nov 06 06:09:08 user nova-compute[74903]:     <acpi/>
Nov 06 06:09:08 user nova-compute[74903]:     <apic/>
Nov 06 06:09:08 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:09:08 user nova-compute[74903]:   </features>
Nov 06 06:09:08 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:09:08 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:09:08 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:09:08 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:09:08 user nova-compute[74903]:   </clock>
Nov 06 06:09:08 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:09:08 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:09:08 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:09:08 user nova-compute[74903]:   </cpu>
Nov 06 06:09:08 user nova-compute[74903]:   <devices>
Nov 06 06:09:08 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:09:08 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:09:08 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk"/>
Nov 06 06:09:08 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:09:08 user nova-compute[74903]:     </disk>
Nov 06 06:09:08 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:09:08 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:09:08 user nova-compute[74903]:       <source dev="/dev/sde"/>
Nov 06 06:09:08 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:09:08 user nova-compute[74903]:       <serial>bcd027d7-2a7e-4487-b862-ced289e35d79</serial>
Nov 06 06:09:08 user nova-compute[74903]:     </disk>
Nov 06 06:09:08 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:09:08 user nova-compute[74903]:       <mac address="fa:16:3e:dd:89:27"/>
Nov 06 06:09:08 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:09:08 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:09:08 user nova-compute[74903]:       <target dev="tapbd470b96-80"/>
Nov 06 06:09:08 user nova-compute[74903]:     </interface>
Nov 06 06:09:08 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:09:08 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/console.log" append="off"/>
Nov 06 06:09:08 user nova-compute[74903]:     </serial>
Nov 06 06:09:08 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:09:08 user nova-compute[74903]:     <video>
Nov 06 06:09:08 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:09:08 user nova-compute[74903]:     </video>
Nov 06 06:09:08 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:09:08 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:09:08 user nova-compute[74903]:     </rng>
Nov 06 06:09:08 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:09:08 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:09:08 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:09:08 user nova-compute[74903]:     </memballoon>
Nov 06 06:09:08 user nova-compute[74903]:   </devices>
Nov 06 06:09:08 user nova-compute[74903]: </domain>
Nov 06 06:09:08 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG os_vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff1159ac-1c50-5d24-88b3-e9d2b4c3b4ff', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd470b96-80, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd470b96-80, col_values=(('qos', UUID('ad197d94-300f-47ab-a65d-b8b87c03b192')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd470b96-80, col_values=(('external_ids', {'iface-id': 'bd470b96-807a-4d77-8af1-362676fa3552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:89:27', 'vm-uuid': '3cff20f3-7370-43ad-a050-1cbd107aaf52'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:08 user nova-compute[74903]: INFO os_vif [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-unplugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] No waiting events found dispatching network-vif-unplugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-547af7b0-3e28-435f-99b3-9d303e052088 req-b1319546-7918-440c-b72c-260af16ff785 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-unplugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:09:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Instance destroyed successfully.
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lazy-loading 'resources' on Instance uuid 673648d8-b84a-43ff-8e2b-e52702a198be {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-506778373',display_name='tempest-VolumesSnapshotTestJSON-instance-506778373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-506778373',id=25,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1XYbWC6nnOoE0BHmlH7RnO5CZZZKhmT9FxwZBfl1D5IBEjcgP3zy54fixbK5suFRLmlcx9AYly8hcN3O2zZKja6XBnMOSXdBZhi3WtHYO999GlPNKdWSuZiOEidMwy9w==',key_name='tempest-keypair-471709284',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ea5f20779e746cdae6c855ac1b044a4',ramdisk_id='',reservation_id='r-1ls7610l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-453337636',owner_user_name='tempest-VolumesSnapshotTestJSON-453337636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a304c402d6c346ff80715df1d2b10107',uuid=673648d8-b84a-43ff-8e2b-e52702a198be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converting VIF {"id": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "address": "fa:16:3e:ea:7e:f6", "network": {"id": "faa45bb9-d55c-4724-90cc-008ac65b80d2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1859235627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ea5f20779e746cdae6c855ac1b044a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3229e50e-e2", "ovs_interfaceid": "3229e50e-e2b1-44c3-b1f1-baa9227ffb2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_vif [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3229e50e-e2, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc1f3f4f-9501-49b9-be04-fbfe329a2ef7) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:09 user nova-compute[74903]: INFO os_vif [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:7e:f6,bridge_name='br-int',has_traffic_filtering=True,id=3229e50e-e2b1-44c3-b1f1-baa9227ffb2a,network=Network(faa45bb9-d55c-4724-90cc-008ac65b80d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3229e50e-e2')
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHcNEKeo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c8737-b203-4c40-92c0-04f5771e0d1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:09:09 user nova-compute[74903]: No targets found.
Nov 06 06:09:09 user nova-compute[74903]: iSNS:
Nov 06 06:09:09 user nova-compute[74903]: No targets found.
Nov 06 06:09:09 user nova-compute[74903]: STATIC:
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:09:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:09 user nova-compute[74903]: FIRMWARE:
Nov 06 06:09:09 user nova-compute[74903]: No targets found.
Nov 06 06:09:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:09:09 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:09:09 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd08391-8348-4601-b855-d8696dc6a496', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[beacf866-11d5-42c2-a461-46bb058d542e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79758be-ca5a-4c4e-bf76-92bbcf3ed1f2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08593370>, {}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Disconnecting from: [] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] <== disconnect_volume: return (87ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:09:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Deleting instance files /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be_del
Nov 06 06:09:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Deletion of /opt/stack/data/nova/instances/673648d8-b84a-43ff-8e2b-e52702a198be_del complete
Nov 06 06:09:09 user nova-compute[74903]: INFO nova.compute.manager [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 06 06:09:09 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:09:09 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:10 user nova-compute[74903]: WARNING nova.compute.manager [req-0a32ba3e-86eb-4145-8fcb-f167906b6c39 req-2272017d-9907-4d2b-9891-63a5baeb9b76 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state resized and task_state resize_reverting.
Nov 06 06:09:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] Acquiring lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] Lock "673648d8-b84a-43ff-8e2b-e52702a198be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] No waiting events found dispatching network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:10 user nova-compute[74903]: WARNING nova.compute.manager [req-12dd923f-cbde-4f79-b7b5-d8bdbca6825b req-9b604209-1ae4-45ed-bcc7-a097dfb54b2a service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received unexpected event network-vif-plugged-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a for instance with vm_state active and task_state deleting.
Nov 06 06:09:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:10 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Took 1.13 seconds to deallocate network for instance.
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: WARNING nova.volume.cinder [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Attachment 773a6518-00e8-4519-bb84-29ca7eb9786a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 773a6518-00e8-4519-bb84-29ca7eb9786a. (HTTP 404) (Request-ID: req-e2debcac-34b0-41aa-a31d-320fe98ab8a2)
Nov 06 06:09:10 user nova-compute[74903]: INFO nova.compute.manager [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 06:09:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:11 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:09:11 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:09:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:11 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Deleted allocations for instance 673648d8-b84a-43ff-8e2b-e52702a198be
Nov 06 06:09:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cc355fd8-e028-43a3-9c9e-0e4a60795aaf tempest-VolumesSnapshotTestJSON-453337636 tempest-VolumesSnapshotTestJSON-453337636-project-member] Lock "673648d8-b84a-43ff-8e2b-e52702a198be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.335s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:09:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance running successfully.
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] finish_revert_migration finished successfully. {{(pid=74903) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 06 06:09:12 user nova-compute[74903]: INFO nova.compute.manager [None req-9375c41b-4be3-4dcc-b293-90a8e3756174 tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance to original state: 'active'
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] [instance: 673648d8-b84a-43ff-8e2b-e52702a198be] Received event network-vif-deleted-3229e50e-e2b1-44c3-b1f1-baa9227ffb2a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:12 user nova-compute[74903]: WARNING nova.compute.manager [req-8c2c002c-9d13-444c-b9c0-1be778fda187 req-3e8d2fac-dcff-4e74-804e-72d741122304 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state resized and task_state resize_reverting.
Nov 06 06:09:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing instance network info cache due to event network-changed-2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Refreshing network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:09:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated VIF entry in instance network info cache for port 2dbd1bff-f466-401e-919d-ef5a28920fe3. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:09:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-72d0392f-35e2-412d-815b-9f6e6d09ed9a req-4c7245ef-5401-47f5-8093-3221f102e71a service nova] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Stashing vm_state: active {{(pid=74903) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:09:18 user nova-compute[74903]: INFO nova.compute.claims [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Claim successful on node user
Nov 06 06:09:18 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating resource usage from migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.652s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:18 user nova-compute[74903]: INFO nova.compute.manager [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Migrating
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-changed-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Refreshing instance network info cache due to event network-changed-2e2b2970-2165-4e87-96f6-8e11994ff516. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Refreshing network info cache for port 2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:09:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updated VIF entry in instance network info cache for port 2e2b2970-2165-4e87-96f6-8e11994ff516. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f68b72e9-d3c3-414d-b576-90c6dd1ec979 req-93a564ac-68e3-4253-bbda-369940dc0985 service nova] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Starting migrate_disk_and_power_off {{(pid=74903) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:20 user nova-compute[74903]: WARNING nova.compute.manager [req-af3e00c4-8bbd-4dcd-b84e-6a9e12170ded req-c05a83b2-8558-4043-9bad-4d0278a8b31e service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state active and task_state resize_migrating.
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance destroyed successfully.
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2b2970-21, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfcedafb-c800-4bfd-b523-1a098cb934b9) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:20 user nova-compute[74903]: INFO os_vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21')
Nov 06 06:09:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:20 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b454a94d-2299-43a8-a83a-a05b155fa1bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:09:20 user nova-compute[74903]: No targets found.
Nov 06 06:09:20 user nova-compute[74903]: iSNS:
Nov 06 06:09:20 user nova-compute[74903]: No targets found.
Nov 06 06:09:20 user nova-compute[74903]: STATIC:
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:09:20 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:09:20 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:09:20 user nova-compute[74903]: FIRMWARE:
Nov 06 06:09:20 user nova-compute[74903]: No targets found.
Nov 06 06:09:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:09:20 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:09:20 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783ff6e-ad91-4247-b8d8-d1a6520f9544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dcaf97-a35a-4fa9-bcee-ce6af973ba30]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:20 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b'): ({'sdh'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Removing single pathed devices sdh {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[431cd565-d389-4a76-875f-b2d591a9e6dc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8fa8e8-4005-4aed-baa3-05d87fa0e791]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flushing IO for device /dev/sdh {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a07cb67-9024-4a65-87be-15fa2835959b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a7f99-e937-4ec1-b802-73b5378efd14]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] SCSI volumes sdh have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b4738a0d', '/dev/disk/by-id/scsi-1SCST_BIOb4738a0d-5a80daf274b96dba', '/dev/disk/by-id/scsi-23561383064616632') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d9661-e294-401d-bdab-c355cb024bbf]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf1c5c1-1b23-4fd5-a787-7f198ca41d1b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749d75e-746c-4539-9331-257837285c66]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]
Nov 06 06:09:20 user nova-compute[74903]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.
Nov 06 06:09:20 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34409d49-b8db-4caf-bc9b-9c7c51f44455]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== disconnect_volume: return (370ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Port 2e2b2970-2165-4e87-96f6-8e11994ff516 binding to destination host user is already ACTIVE {{(pid=74903) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:22 user nova-compute[74903]: WARNING nova.compute.manager [req-0731be33-24a6-4537-b80d-4555e1438732 req-9310fa9c-4c82-4976-9aac-8e1d0aa76dc2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state active and task_state resize_migrating.
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.utils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c131508-a314-4ceb-89a5-856d641dfd14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5158283-de27-4cf7-aeba-b88d7ed80cb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad950cf9-1ab1-4f2f-9e2f-4141856a6a04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[13841a48-a206-4325-8fca-6a5ca3a5fdb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:09:23 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba5ede-cea4-4deb-896d-8b959c336754]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG os_brick.utils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:26 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:26 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7007MB free_disk=25.162052154541016GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Applying migration context for instance c907ba0f-9dd8-494a-846d-13758db2fabc as it has an incoming, in-progress migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62. Migration status is post-migrating {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 06:09:26 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating resource usage from migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8239a418-b65a-4d4f-95dd-efe0e836403a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 6a685cae-989a-473d-80b9-ded3974de38c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:09:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:09:27 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:09:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:09:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:09:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:29 user nova-compute[74903]: INFO nova.compute.manager [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Terminating instance
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ad3503f-73ab-4b43-9a84-5360372e92fb req-9ec9df05-ce8a-4955-8f06-c68c45e56d29 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-unplugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Instance destroyed successfully.
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'resources' on Instance uuid 6a685cae-989a-473d-80b9-ded3974de38c {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1784805946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1784805946',id=19,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRiYW4ukChs+JZOBpsK9ynUaGRNjeWYCJO6a2zz4ZoAtjjYxe/YVN1ryCoIZ5nJJ953kmtJ2Lc82AxpuoEvEcoHLeOOEJXP9F7+HG6Cm/2afiYjncfeAGjopBOBB+JcGA==',key_name='tempest-keypair-610860067',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-wbgw2qd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=6a685cae-989a-473d-80b9-ded3974de38c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "address": "fa:16:3e:b7:be:02", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d84ce5-1c", "ovs_interfaceid": "e1d84ce5-1ca7-4cbc-a19a-379a9dec744a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG os_vif [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d84ce5-1c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05d47e71-2852-4e87-89a5-ea11af431200) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:29 user nova-compute[74903]: INFO os_vif [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:be:02,bridge_name='br-int',has_traffic_filtering=True,id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d84ce5-1c')
Nov 06 06:09:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Deleting instance files /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c_del
Nov 06 06:09:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Deletion of /opt/stack/data/nova/instances/6a685cae-989a-473d-80b9-ded3974de38c_del complete
Nov 06 06:09:30 user nova-compute[74903]: INFO nova.compute.manager [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 06 06:09:30 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:30 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Took 0.86 seconds to deallocate network for instance.
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-85edbbd8-8df4-4006-b203-e8d9d873c119 req-d97f1278-0fe6-44ac-a319-3f25d2b531e1 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-deleted-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:30 user nova-compute[74903]: INFO nova.compute.manager [req-85edbbd8-8df4-4006-b203-e8d9d873c119 req-d97f1278-0fe6-44ac-a319-3f25d2b531e1 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Neutron deleted interface e1d84ce5-1ca7-4cbc-a19a-379a9dec744a; detaching it from the instance and deleting it from the info cache
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-85edbbd8-8df4-4006-b203-e8d9d873c119 req-d97f1278-0fe6-44ac-a319-3f25d2b531e1 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-85edbbd8-8df4-4006-b203-e8d9d873c119 req-d97f1278-0fe6-44ac-a319-3f25d2b531e1 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Detach interface failed, port_id=e1d84ce5-1ca7-4cbc-a19a-379a9dec744a, reason: Instance 6a685cae-989a-473d-80b9-ded3974de38c could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] Acquiring lock "6a685cae-989a-473d-80b9-ded3974de38c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] Lock "6a685cae-989a-473d-80b9-ded3974de38c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] No waiting events found dispatching network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:31 user nova-compute[74903]: WARNING nova.compute.manager [req-4c337b62-ce7b-4c33-a766-88cd7d125ba8 req-1d419df6-52c3-4dcd-a20e-c8ab08ba53c6 service nova] [instance: 6a685cae-989a-473d-80b9-ded3974de38c] Received unexpected event network-vif-plugged-e1d84ce5-1ca7-4cbc-a19a-379a9dec744a for instance with vm_state deleted and task_state None.
Nov 06 06:09:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:31 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Deleted allocations for instance 6a685cae-989a-473d-80b9-ded3974de38c
Nov 06 06:09:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3ab6578c-b187-4e37-80f9-9ee764997e8d tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "6a685cae-989a-473d-80b9-ded3974de38c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Starting finish_migration {{(pid=74903) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:09:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Creating image(s)
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Ensure instance console log exists: /opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start _get_guest_xml network_info=[{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c907ba0f-9dd8-494a-846d-13758db2fabc', 'attached_at': '2023-11-06T06:09:48.000000', 'detached_at': '', 'volume_id': 'cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'serial': 'cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'fc9b7ccc-65bd-4104-b37e-af3ed44fb01f', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:09:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:09:47 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:47 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:09:47 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[70914bc3-d173-4c01-ae84-9c3c9f5472c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:09:47 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c913808-7031-4a46-866c-80f597edb1ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b] added
Nov 06 06:09:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeab3505-258d-4891-8d49-52c6ff6b0628]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bcb651-999f-4b10-b1cc-d6ecaa71de28]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEOcPlox {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEOcPlox" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4802d707-0896-4e80-b7bd-c6e235b3e749]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEOcPlox'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d054d01-d179-4eed-b711-f5312a16dc28]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e6af7-a859-4524-a0b6-4a1ed0f6fa3c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814daca-aa4e-439b-ab51-ae5b0499d2d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]
Nov 06 06:09:48 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.
Nov 06 06:09:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1717d6b-babd-435f-9f7f-bb8072ee76c9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a9791-c6ed-435e-89c0-baa62bc3c5c4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:09:48 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:09:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5d75e-0a7c-4f7d-ac3e-12a47f7a977a]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:09:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23561383064616632', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561383064616632', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:09:49 user nova-compute[74903]:   <uuid>c907ba0f-9dd8-494a-846d-13758db2fabc</uuid>
Nov 06 06:09:49 user nova-compute[74903]:   <name>instance-0000001b</name>
Nov 06 06:09:49 user nova-compute[74903]:   <memory>2097152</memory>
Nov 06 06:09:49 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:09:49 user nova-compute[74903]:   <metadata>
Nov 06 06:09:49 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:09:49 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:09:49 user nova-compute[74903]:       <nova:name>tempest-ServerActionsTestOtherA-server-217797069</nova:name>
Nov 06 06:09:49 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:09:47</nova:creationTime>
Nov 06 06:09:49 user nova-compute[74903]:       <nova:flavor name="m1.small">
Nov 06 06:09:49 user nova-compute[74903]:         <nova:memory>2048</nova:memory>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:disk>20</nova:disk>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:09:49 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:09:49 user nova-compute[74903]:       <nova:owner>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:user uuid="44c3df905516436e8a6c39e0f32a2e4b">tempest-ServerActionsTestOtherA-851074598-project-member</nova:user>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:project uuid="29b574412f0d4156a9d4538b17b2c163">tempest-ServerActionsTestOtherA-851074598</nova:project>
Nov 06 06:09:49 user nova-compute[74903]:       </nova:owner>
Nov 06 06:09:49 user nova-compute[74903]:       <nova:ports>
Nov 06 06:09:49 user nova-compute[74903]:         <nova:port uuid="2e2b2970-2165-4e87-96f6-8e11994ff516">
Nov 06 06:09:49 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 06:09:49 user nova-compute[74903]:         </nova:port>
Nov 06 06:09:49 user nova-compute[74903]:       </nova:ports>
Nov 06 06:09:49 user nova-compute[74903]:     </nova:instance>
Nov 06 06:09:49 user nova-compute[74903]:   </metadata>
Nov 06 06:09:49 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:09:49 user nova-compute[74903]:     <system>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="serial">c907ba0f-9dd8-494a-846d-13758db2fabc</entry>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="uuid">c907ba0f-9dd8-494a-846d-13758db2fabc</entry>
Nov 06 06:09:49 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:09:49 user nova-compute[74903]:     </system>
Nov 06 06:09:49 user nova-compute[74903]:   </sysinfo>
Nov 06 06:09:49 user nova-compute[74903]:   <os>
Nov 06 06:09:49 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:09:49 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:09:49 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:09:49 user nova-compute[74903]:   </os>
Nov 06 06:09:49 user nova-compute[74903]:   <features>
Nov 06 06:09:49 user nova-compute[74903]:     <acpi/>
Nov 06 06:09:49 user nova-compute[74903]:     <apic/>
Nov 06 06:09:49 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:09:49 user nova-compute[74903]:   </features>
Nov 06 06:09:49 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:09:49 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:09:49 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:09:49 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:09:49 user nova-compute[74903]:   </clock>
Nov 06 06:09:49 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:09:49 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:09:49 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:09:49 user nova-compute[74903]:   </cpu>
Nov 06 06:09:49 user nova-compute[74903]:   <devices>
Nov 06 06:09:49 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:09:49 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:09:49 user nova-compute[74903]:       <source dev="/dev/sdf"/>
Nov 06 06:09:49 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:09:49 user nova-compute[74903]:       <serial>cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b</serial>
Nov 06 06:09:49 user nova-compute[74903]:     </disk>
Nov 06 06:09:49 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:09:49 user nova-compute[74903]:       <mac address="fa:16:3e:b2:47:78"/>
Nov 06 06:09:49 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:09:49 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:09:49 user nova-compute[74903]:       <target dev="tap2e2b2970-21"/>
Nov 06 06:09:49 user nova-compute[74903]:     </interface>
Nov 06 06:09:49 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:09:49 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc/console.log" append="off"/>
Nov 06 06:09:49 user nova-compute[74903]:     </serial>
Nov 06 06:09:49 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:09:49 user nova-compute[74903]:     <video>
Nov 06 06:09:49 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:09:49 user nova-compute[74903]:     </video>
Nov 06 06:09:49 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:09:49 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:09:49 user nova-compute[74903]:     </rng>
Nov 06 06:09:49 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:09:49 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:09:49 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:09:49 user nova-compute[74903]:     </memballoon>
Nov 06 06:09:49 user nova-compute[74903]:   </devices>
Nov 06 06:09:49 user nova-compute[74903]: </domain>
Nov 06 06:09:49 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:09:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-581362795-network", "vif_mac": "fa:16:3e:b2:47:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG os_vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12198b76-0481-5909-b13b-b07dd1086441', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e2b2970-21, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e2b2970-21, col_values=(('qos', UUID('cf734fc3-47ae-4e2a-9606-bb9a07bf0a7b')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e2b2970-21, col_values=(('external_ids', {'iface-id': '2e2b2970-2165-4e87-96f6-8e11994ff516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:47:78', 'vm-uuid': 'c907ba0f-9dd8-494a-846d-13758db2fabc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:49 user nova-compute[74903]: INFO os_vif [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21')
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:09:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] No VIF found with MAC fa:16:3e:b2:47:78, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:50 user nova-compute[74903]: WARNING nova.compute.manager [req-f9385040-b014-4f13-890b-55574c62ad39 req-f680f192-637b-476f-993a-47b1d4dd46fc service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state active and task_state resize_finish.
Nov 06 06:09:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:09:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance running successfully.
Nov 06 06:09:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Failed to set time: agent not configured {{(pid=74903) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6e32931b-fc46-431e-8090-8cef53a93103 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] finish_migration finished successfully. {{(pid=74903) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:09:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:09:52 user nova-compute[74903]: WARNING nova.compute.manager [req-4d9b1163-5912-49ad-882a-1957e4ebb89c req-40e97057-7bca-4847-9077-7a618e6a7a13 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state active and task_state resize_finish.
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing instance network info cache due to event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.network.neutron [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.network.neutron [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updated VIF entry in instance network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.network.neutron [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65e828af-dff3-45d2-8834-c4e19ea88527 req-7b2ed723-4d2b-49bf-a4a8-3ea5a2ec23c4 service nova] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:09:53 user nova-compute[74903]: INFO nova.compute.manager [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Detaching volume fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:09:53 user nova-compute[74903]: INFO nova.virt.block_device [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Attempting to driver detach volume fd82875d-6c9d-4197-a442-ba11f828cdb0 from mountpoint /dev/vdb
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Attempting to detach device vdb from instance 457a1716-198e-4054-b665-9e9af54f8c09 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:09:53 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:09:53 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:09:53 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:09:53 user nova-compute[74903]:   <serial>fd82875d-6c9d-4197-a442-ba11f828cdb0</serial>
Nov 06 06:09:53 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:09:53 user nova-compute[74903]: </disk>
Nov 06 06:09:53 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:09:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully detached device vdb from instance 457a1716-198e-4054-b665-9e9af54f8c09 from the persistent domain config.
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 457a1716-198e-4054-b665-9e9af54f8c09 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:09:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:09:53 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:09:53 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:09:53 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:09:53 user nova-compute[74903]:   <serial>fd82875d-6c9d-4197-a442-ba11f828cdb0</serial>
Nov 06 06:09:53 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:09:53 user nova-compute[74903]: </disk>
Nov 06 06:09:53 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:09:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:09:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:09:55 user nova-compute[74903]: DEBUG nova.compute.manager [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing instance network info cache due to event network-changed-63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:09:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] Acquiring lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:09:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] Acquired lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:09:55 user nova-compute[74903]: DEBUG nova.network.neutron [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Refreshing network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:09:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updated VIF entry in instance network info cache for port 63e0d648-6523-4aa2-8200-7f3e73a45080. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:09:56 user nova-compute[74903]: DEBUG nova.network.neutron [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [{"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:09:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-127caabb-0f41-4dbc-8ca7-d10295a81116 req-7e0867d8-6c08-4f1c-ae95-dda1beef6417 service nova] Releasing lock "refresh_cache-457a1716-198e-4054-b665-9e9af54f8c09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:09:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:09:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:08 user nova-compute[74903]: INFO nova.compute.manager [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Terminating instance
Nov 06 06:10:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-unplugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] No waiting events found dispatching network-vif-unplugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-c02aa045-8627-4c31-9b83-e0032dea38a2 req-1c5bab39-4a84-4492-a646-dfa0e5da6beb service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-unplugged-a140e256-f8be-4d67-b38e-5832d2a6e650 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Instance destroyed successfully.
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lazy-loading 'resources' on Instance uuid 8239a418-b65a-4d4f-95dd-efe0e836403a {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847509246',display_name='tempest-SnapshotDataIntegrityTests-server-1847509246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847509246',id=17,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImVYh0TdOY9geuIz0tsh0pqo8VLmdthZiXW9e6boHOcRufzhq4oG0Zr3o2FgRGcj9ar4sdSZsnUrEP6S0c+8IxvC7z8zOgDImSpumzkgQl6cfX7qYIj17ArxlKI6bT87w==',key_name='tempest-keypair-1221083766',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce1a98b600f441ba91bca64ad194e4b6',ramdisk_id='',reservation_id='r-lmia2k6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2107137012',owner_user_name='tempest-SnapshotDataIntegrityTests-2107137012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b72fa5945c34f89a8e3c554f0cfac13',uuid=8239a418-b65a-4d4f-95dd-efe0e836403a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converting VIF {"id": "a140e256-f8be-4d67-b38e-5832d2a6e650", "address": "fa:16:3e:8a:34:7f", "network": {"id": "6b9a6958-353d-4729-b1c5-190e8260f435", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1784913616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce1a98b600f441ba91bca64ad194e4b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa140e256-f8", "ovs_interfaceid": "a140e256-f8be-4d67-b38e-5832d2a6e650", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG os_vif [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa140e256-f8, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1d4ef92-8382-4119-b461-77bc241b1685) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:09 user nova-compute[74903]: INFO os_vif [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:34:7f,bridge_name='br-int',has_traffic_filtering=True,id=a140e256-f8be-4d67-b38e-5832d2a6e650,network=Network(6b9a6958-353d-4729-b1c5-190e8260f435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa140e256-f8')
Nov 06 06:10:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Deleting instance files /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a_del
Nov 06 06:10:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Deletion of /opt/stack/data/nova/instances/8239a418-b65a-4d4f-95dd-efe0e836403a_del complete
Nov 06 06:10:09 user nova-compute[74903]: INFO nova.compute.manager [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:10:09 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:10:09 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-changed-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Refreshing instance network info cache due to event network-changed-027a8450-74fc-47bc-a736-5e446e737bd3. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] Acquiring lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] Acquired lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG nova.network.neutron [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Refreshing network info cache for port 027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:10 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Took 0.98 seconds to deallocate network for instance.
Nov 06 06:10:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.network.neutron [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updated VIF entry in instance network info cache for port 027a8450-74fc-47bc-a736-5e446e737bd3. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.network.neutron [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5006cac9-95c5-44a5-a239-e48a42322e11 req-d70db62e-3e9e-4fe8-a89e-28a2bce0c548 service nova] Releasing lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] Acquiring lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] No waiting events found dispatching network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:11 user nova-compute[74903]: WARNING nova.compute.manager [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received unexpected event network-vif-plugged-a140e256-f8be-4d67-b38e-5832d2a6e650 for instance with vm_state deleted and task_state None.
Nov 06 06:10:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0864e90-74b8-440b-93b9-d4e043130a81 req-11bd6d82-4f43-4931-83a8-ec909f7c8fe8 service nova] [instance: 8239a418-b65a-4d4f-95dd-efe0e836403a] Received event network-vif-deleted-a140e256-f8be-4d67-b38e-5832d2a6e650 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:11 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Deleted allocations for instance 8239a418-b65a-4d4f-95dd-efe0e836403a
Nov 06 06:10:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6dee23b-2459-4c9c-808c-ea8251244002 tempest-SnapshotDataIntegrityTests-2107137012 tempest-SnapshotDataIntegrityTests-2107137012-project-member] Lock "8239a418-b65a-4d4f-95dd-efe0e836403a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.649s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing instance network info cache due to event network-changed-b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] Acquiring lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] Acquired lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.network.neutron [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Refreshing network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [{"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-127b0dcc-cddc-41a1-b66f-42b1eee09849" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:13 user nova-compute[74903]: INFO nova.compute.manager [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Terminating instance
Nov 06 06:10:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:10:14 user nova-compute[74903]: INFO nova.compute.manager [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Rescuing
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 457a1716-198e-4054-b665-9e9af54f8c09 is timed out.
Nov 06 06:10:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully detached device vdb from instance 457a1716-198e-4054-b665-9e9af54f8c09 from the live domain config.
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Fpbmyhqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:10:14 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c1e739-6494-489d-8993-bb8e6c4b15df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]: iSNS:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]: STATIC:
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: FIRMWARE:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:10:14 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:10:14 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-daf9578c-7608-4320-a5cf-2555e938126e req-c81b4f3b-e0fc-4d3c-813c-37e9d7c7c93e service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-unplugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[25910171-91fc-421a-a720-94d5ebbb147b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee3691-805d-4e23-9e3c-8e6d72479dbf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa286f49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8050d5-39e9-479a-a0ae-07053fd367f3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[172c6fd6-a0e5-4698-a3e5-7555db657d44]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66fd23-6885-41fc-8f39-528ea15022be]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3c7f6f-3b33-46df-9ecf-4f85919429e0]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a079a711-4a81-4fd0-a466-74b67750d361]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Instance destroyed successfully.
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.objects.instance [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lazy-loading 'resources' on Instance uuid c4c9a4d3-6553-48f6-85b1-00d9c905cc50 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:03:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-865305500',display_name='tempest-TestShelveInstance-server-865305500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-865305500',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpweiMHBr6jQ+m9OIYh7A/g+dNeJ/4KwTlhdSahFJAu3qKEWlBKpnoUpoGy1+sEGUfR/oA1LSExC4cUGfqlVDNGqMM769vNAXCBv/ZqxlXj+kYUtmAflt1VH5R0oPJU8A==',key_name='tempest-TestShelveInstance-2063912077',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:08:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90ac1d35737f4599bfc799afb620174c',ramdisk_id='',reservation_id='r-lvmyymgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1152944910',owner_user_name='tempest-TestShelveInstance-1152944910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:08:39Z,user_data=None,user_id='9f23b6ac95ae4183a9f74b1927407f2e',uuid=c4c9a4d3-6553-48f6-85b1-00d9c905cc50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converting VIF {"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_vif [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb35081d0-53, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d359153-cdfa-4a85-aa37-a7e351e48f29) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:14 user nova-compute[74903]: INFO os_vif [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:da:2c,bridge_name='br-int',has_traffic_filtering=True,id=b35081d0-53fc-4c39-a633-7ce512bfc52f,network=Network(cfb4916d-4b8e-4e92-b859-5dbc9129f507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb35081d0-53')
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWzdIsUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:10:14 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[50619d42-bc09-4016-8950-f71eb47f3e3a]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260]
Nov 06 06:10:14 user nova-compute[74903]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0, portal: 172.16.0.220,3260] successful.
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd82875d-6c9d-4197-a442-ba11f828cdb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7039873d-cd44-4a20-84ee-4d78769f7101]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] <== disconnect_volume: return (419ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.082s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb3b93-6f49-4d13-850a-cc80b0ca9d74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]: iSNS:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]: STATIC:
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:10:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:10:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:10:14 user nova-compute[74903]: FIRMWARE:
Nov 06 06:10:14 user nova-compute[74903]: No targets found.
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:10:14 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:10:14 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updated VIF entry in instance network info cache for port b35081d0-53fc-4c39-a633-7ce512bfc52f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [{"id": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "address": "fa:16:3e:77:da:2c", "network": {"id": "cfb4916d-4b8e-4e92-b859-5dbc9129f507", "bridge": "br-int", "label": "tempest-TestShelveInstance-1046162201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90ac1d35737f4599bfc799afb620174c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb35081d0-53", "ovs_interfaceid": "b35081d0-53fc-4c39-a633-7ce512bfc52f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b04845-1f85-4282-b9db-535af4e60115]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-080d7553-2739-4fc9-8071-0e3dc6525eb7 req-b8c3112a-64ef-41fe-9db2-4bb0de9aef62 service nova] Releasing lock "refresh_cache-c4c9a4d3-6553-48f6-85b1-00d9c905cc50" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[221554b9-10a2-4090-ad46-df9b26eee44b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:14 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa285d84c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2920d712-2982-415e-8cc2-8b97e652060e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0ab0cc-2286-407c-8431-5fe027dc0444]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f6b43d-7bef-42e9-9a0c-da6e3ebd963b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18e336-317b-4996-95be-efdfe6670ce1]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating instance_info_cache with network_info: [{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ddd2b0-dc40-45f7-b430-057a151a5a3b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf4995c-4457-419a-b2fe-41cf32eba84e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260]
Nov 06 06:10:15 user nova-compute[74903]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9, portal: 172.16.0.220,3260] successful.
Nov 06 06:10:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b89cecf-83ad-413d-ad2c-db8205ab62a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a8201-2670-431e-8237-6385232d7f38]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] <== disconnect_volume: return (506ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:10:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deleting instance files /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50_del
Nov 06 06:10:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deletion of /opt/stack/data/nova/instances/c4c9a4d3-6553-48f6-85b1-00d9c905cc50_del complete
Nov 06 06:10:15 user nova-compute[74903]: INFO nova.compute.manager [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 06 06:10:15 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance destroyed successfully.
Nov 06 06:10:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Attempting a stable device rescue
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:16 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Took 0.82 seconds to deallocate network for instance.
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:10:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Creating image(s)
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'trusted_certs' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Acquiring lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] No waiting events found dispatching network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:16 user nova-compute[74903]: WARNING nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received unexpected event network-vif-plugged-b35081d0-53fc-4c39-a633-7ce512bfc52f for instance with vm_state active and task_state deleting.
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:16 user nova-compute[74903]: WARNING nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state active and task_state rescuing.
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Received event network-vif-deleted-b35081d0-53fc-4c39-a633-7ce512bfc52f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:16 user nova-compute[74903]: WARNING nova.compute.manager [req-e0bdd838-5a01-460d-92c4-696b7af3db30 req-fcb42077-92a6-486e-8008-87b4afb9b99a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state active and task_state rescuing.
Nov 06 06:10:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG nova.virt.images [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] 27755a8e-fbf6-4e22-bd79-158a8af5e904 was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.part /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:17 user nova-compute[74903]: INFO nova.compute.manager [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Took 1.52 seconds to detach 1 volumes for instance.
Nov 06 06:10:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] [instance: c4c9a4d3-6553-48f6-85b1-00d9c905cc50] Deleting volume: 1b89cecf-83ad-413d-ad2c-db8205ab62a9 {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.part /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.converted" returned: 0 in 0.555s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.227s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.638s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7,backing_fmt=raw /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Deleted allocations for instance c4c9a4d3-6553-48f6-85b1-00d9c905cc50
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7,backing_fmt=raw /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue" returned: 0 in 0.055s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'migration_context' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<f07c272e-7eb5-485a-8ad7-c15b9a1be2c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start _get_guest_xml network_info=[{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:89:db:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '27755a8e-fbf6-4e22-bd79-158a8af5e904', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'f07c272e-7eb5-485a-8ad7-c15b9a1be2c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccbf57d7-2345-4449-b851-8eaac2bff222', 'serial': 'ccbf57d7-2345-4449-b851-8eaac2bff222'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a624485f-ca9b-497c-9d12-5a80d6921e2d', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<f07c272e-7eb5-485a-8ad7-c15b9a1be2c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'numa_topology' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<f07c272e-7eb5-485a-8ad7-c15b9a1be2c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:10:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'vcpu_model' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.objects.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<f07c272e-7eb5-485a-8ad7-c15b9a1be2c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:10:18 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:10:18 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:10:18 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-be242f16-1a5f-4b08-b2b7-0a6dc247a653 tempest-TestShelveInstance-1152944910 tempest-TestShelveInstance-1152944910-project-member] Lock "c4c9a4d3-6553-48f6-85b1-00d9c905cc50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.922s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cc4c56-61f5-4c59-981f-3a1e45af2c80]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZnYEKWTv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 06:10:18 user nova-compute[74903]: node.name = iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:10:18 user nova-compute[74903]: node.tpgt = -1
Nov 06 06:10:18 user nova-compute[74903]: node.startup = automatic
Nov 06 06:10:18 user nova-compute[74903]: node.leading_login = No
Nov 06 06:10:18 user nova-compute[74903]: iface.iscsi_ifacename = default
Nov 06 06:10:18 user nova-compute[74903]: iface.net_ifacename = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.ipaddress = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.prefix_len = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.hwaddress = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.transport_name = tcp
Nov 06 06:10:18 user nova-compute[74903]: iface.initiatorname = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.vlan_id = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.vlan_priority = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.vlan_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.iface_num = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.mtu = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.port = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.bootproto = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.subnet_mask = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.gateway = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_alt_client_id = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_dns = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_learn_iqn = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_vendor_id_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_vendor_id = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.dhcp_slp_da = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.fragmentation = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.gratuitous_arp = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.incoming_forwarding = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.tos_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.tos = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.ttl = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.delayed_ack = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.tcp_nagle = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.tcp_wsf_state = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.tcp_wsf = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.tcp_timer_scale = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.tcp_timestamp = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.redirect = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.def_task_mgmt_timeout = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.header_digest = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.data_digest = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.immediate_data = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.initial_r2t = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.data_seq_inorder = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.data_pdu_inorder = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.erl = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.max_receive_data_len = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.first_burst_len = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.max_outstanding_r2t = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.max_burst_len = 0
Nov 06 06:10:18 user nova-compute[74903]: iface.chap_auth = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.bidi_chap = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.strict_login_compliance = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.discovery_auth = <empty>
Nov 06 06:10:18 user nova-compute[74903]: iface.discovery_logout = <empty>
Nov 06 06:10:18 user nova-compute[74903]: node.discovery_address = <empty>
Nov 06 06:10:18 user nova-compute[74903]: node.discovery_port = 0
Nov 06 06:10:18 user nova-compute[74903]: node.discovery_type = static
Nov 06 06:10:18 user nova-compute[74903]: node.session.initial_cmdsn = 0
Nov 06 06:10:18 user nova-compute[74903]: node.session.initial_login_retry_max = 8
Nov 06 06:10:18 user nova-compute[74903]: node.session.xmit_thread_priority = -20
Nov 06 06:10:18 user nova-compute[74903]: node.session.cmds_max = 128
Nov 06 06:10:18 user nova-compute[74903]: node.session.queue_depth = 32
Nov 06 06:10:18 user nova-compute[74903]: node.session.nr_sessions = 1
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.authmethod = CHAP
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.username = ZnYEKWTv
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.password = ***
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.username_in = <empty>
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.password_in = <empty>
Nov 06 06:10:18 user nova-compute[74903]: node.session.auth.chap_algs = MD5
Nov 06 06:10:18 user nova-compute[74903]: node.session.timeo.replacement_timeout = 120
Nov 06 06:10:18 user nova-compute[74903]: node.session.err_timeo.abort_timeout = 15
Nov 06 06:10:18 user nova-compute[74903]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 06:10:18 user nova-compute[74903]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 06:10:18 user nova-compute[74903]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.FastAbort = Yes
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.InitialR2T = No
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.ImmediateData = Yes
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.MaxConnections = 1
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 06:10:18 user nova-compute[74903]: node.session.iscsi.ERL = 0
Nov 06 06:10:18 user nova-compute[74903]: node.session.scan = manual
Nov 06 06:10:18 user nova-compute[74903]: node.session.reopen_max = 0
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].address = 172.16.0.220
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].port = 3260
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].startup = manual
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].tcp.window_size = 524288
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].tcp.type_of_service = 0
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].timeo.logout_timeout = 15
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].timeo.login_timeout = 15
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].timeo.auth_timeout = 45
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.DataDigest = None
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.IFMarker = No
Nov 06 06:10:18 user nova-compute[74903]: node.conn[0].iscsi.OFMarker = No
Nov 06 06:10:18 user nova-compute[74903]: # END RECORD
Nov 06 06:10:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f7ae85-50d0-4686-b949-1d356a97933a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb02069f-0a79-4499-a5b4-943e00a13550]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnYEKWTv {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZnYEKWTv" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65f4c6-dc37-4877-8442-7a957b333bdc]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZnYEKWTv'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ba2f1-c18d-4fc9-bbf7-7b380ae57a15]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:10:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eee179-14d2-4046-a27b-c462e5b9ad8f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3d933b0-9829-4838-86f7-68a71ae1b907 (non-flash)
Nov 06 06:10:19 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:10:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] HCTL ('41', '0', '0', 0) found on session 29 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Scanning host 41 c: 0, t: 0, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb611c4d-b3c3-4d2b-976f-01665306b420]: (4, ('0 0 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Searching for a device in session 29 and hctl ('41', '0', '0', 0) yield: sdj {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23662653439326636', 'path': '/dev/sdj'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662653439326636', 'path': '/dev/sdj'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-117646916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-117646916',id=28,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-eefndi30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:08:37Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=f07c272e-7eb5-485a-8ad7-c15b9a1be2c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:89:db:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "vif_mac": "fa:16:3e:89:db:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'pci_devices' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.objects.base [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Object Instance<f07c272e-7eb5-485a-8ad7-c15b9a1be2c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:10:19 user nova-compute[74903]:   <uuid>f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</uuid>
Nov 06 06:10:19 user nova-compute[74903]:   <name>instance-0000001c</name>
Nov 06 06:10:19 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:10:19 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:10:19 user nova-compute[74903]:   <metadata>
Nov 06 06:10:19 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:10:19 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-117646916</nova:name>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:10:18</nova:creationTime>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:10:19 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:10:19 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:owner>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:user uuid="8d10322732ce4e93b049be06ad946cab">tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member</nova:user>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:project uuid="af82cdc03f0241bb8de82b8fb9d7a66c">tempest-ServerBootFromVolumeStableRescueTest-261817602</nova:project>
Nov 06 06:10:19 user nova-compute[74903]:       </nova:owner>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:10:19 user nova-compute[74903]:       <nova:ports>
Nov 06 06:10:19 user nova-compute[74903]:         <nova:port uuid="ae056fd7-a484-4ed4-b25f-8671ed4df9b6">
Nov 06 06:10:19 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 06:10:19 user nova-compute[74903]:         </nova:port>
Nov 06 06:10:19 user nova-compute[74903]:       </nova:ports>
Nov 06 06:10:19 user nova-compute[74903]:     </nova:instance>
Nov 06 06:10:19 user nova-compute[74903]:   </metadata>
Nov 06 06:10:19 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:10:19 user nova-compute[74903]:     <system>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="serial">f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</entry>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="uuid">f07c272e-7eb5-485a-8ad7-c15b9a1be2c1</entry>
Nov 06 06:10:19 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:10:19 user nova-compute[74903]:     </system>
Nov 06 06:10:19 user nova-compute[74903]:   </sysinfo>
Nov 06 06:10:19 user nova-compute[74903]:   <os>
Nov 06 06:10:19 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:10:19 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:10:19 user nova-compute[74903]:   </os>
Nov 06 06:10:19 user nova-compute[74903]:   <features>
Nov 06 06:10:19 user nova-compute[74903]:     <acpi/>
Nov 06 06:10:19 user nova-compute[74903]:     <apic/>
Nov 06 06:10:19 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:10:19 user nova-compute[74903]:   </features>
Nov 06 06:10:19 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:10:19 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:10:19 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:10:19 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:10:19 user nova-compute[74903]:   </clock>
Nov 06 06:10:19 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:10:19 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:10:19 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:10:19 user nova-compute[74903]:   </cpu>
Nov 06 06:10:19 user nova-compute[74903]:   <devices>
Nov 06 06:10:19 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:10:19 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:10:19 user nova-compute[74903]:       <source dev="/dev/sdj"/>
Nov 06 06:10:19 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:10:19 user nova-compute[74903]:       <serial>ccbf57d7-2345-4449-b851-8eaac2bff222</serial>
Nov 06 06:10:19 user nova-compute[74903]:     </disk>
Nov 06 06:10:19 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:10:19 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:10:19 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue"/>
Nov 06 06:10:19 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:10:19 user nova-compute[74903]:       <boot order="1"/>
Nov 06 06:10:19 user nova-compute[74903]:     </disk>
Nov 06 06:10:19 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:10:19 user nova-compute[74903]:       <mac address="fa:16:3e:89:db:1a"/>
Nov 06 06:10:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:10:19 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:10:19 user nova-compute[74903]:       <target dev="tapae056fd7-a4"/>
Nov 06 06:10:19 user nova-compute[74903]:     </interface>
Nov 06 06:10:19 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:10:19 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/console.log" append="off"/>
Nov 06 06:10:19 user nova-compute[74903]:     </serial>
Nov 06 06:10:19 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:10:19 user nova-compute[74903]:     <video>
Nov 06 06:10:19 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:10:19 user nova-compute[74903]:     </video>
Nov 06 06:10:19 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:10:19 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:10:19 user nova-compute[74903]:     </rng>
Nov 06 06:10:19 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:10:19 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:10:19 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:10:19 user nova-compute[74903]:     </memballoon>
Nov 06 06:10:19 user nova-compute[74903]:   </devices>
Nov 06 06:10:19 user nova-compute[74903]: </domain>
Nov 06 06:10:19 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:10:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance destroyed successfully.
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] No VIF found with MAC fa:16:3e:89:db:1a, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:10:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:21 user nova-compute[74903]: WARNING nova.compute.manager [req-f19d0f1f-94f9-4389-92fc-7e3d2eaee92f req-4ac59133-4c93-4863-a53f-d0d825a942a7 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state active and task_state rescuing.
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:10:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:10:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:23 user nova-compute[74903]: WARNING nova.compute.manager [req-1b9d327d-f6de-49cc-9d72-b03a4966c38d req-62d6054a-fa57-4ecd-a1a7-5feb98ddf9b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state active and task_state rescuing.
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f6e1c192-8fbe-4546-a036-d15c0e131eb4 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:10:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json" returned: 0 in 0.538s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:10:25 user nova-compute[74903]: INFO nova.compute.claims [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Claim successful on node user
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG nova.objects.instance [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'flavor' on Instance uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.274s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.534s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'flavor' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:27 user nova-compute[74903]: INFO nova.compute.manager [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Attaching volume 71a603de-066e-436f-ba43-b71c7fc15c89 to /dev/vdb
Nov 06 06:10:27 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80c52f7-97e7-4999-a2a0-96361435d5fe tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.468s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.utils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[048082a8-aad9-410b-9330-abc55a9fe623]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.policy [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16796bd87812434689edbdde4d086818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '371e43fd9d594cd6afca5da129747603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[88be4125-b4d4-4738-8fe2-d2e4ab35ff87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09666b4-17cc-42e6-b6f6-2ce2c4bc87e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbbadaa-3ff9-4dbd-b210-4dfd36832d43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.463s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:10:27 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e6faf1-c74d-49e2-af54-151dadb37b50]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:10:27 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Creating image(s)
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG os_brick.utils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] <== get_connector_properties: return (304ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating existing volume attachment record: dcaac0f1-d55c-42b9-afe2-1d8c72440a88 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Successfully created port: dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.891s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:28 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7401MB free_disk=24.889789581298828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.230s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Applying migration context for instance c907ba0f-9dd8-494a-846d-13758db2fabc as it has an incoming, in-progress migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62. Migration status is finished {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 06:10:28 user nova-compute[74903]: INFO nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating resource usage from migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk 1073741824" returned: 0 in 0.076s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 457a1716-198e-4054-b665-9e9af54f8c09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:10:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.270s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Cannot resize image /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Ensure instance console log exists: /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.005s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Successfully updated port: dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing instance network info cache due to event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance network_info: |[{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start _get_guest_xml network_info=[{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:10:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh6eJHL+FCKM86OoBb7Xbywn1oDRpdylkpGOm1nqTP1B/yd47syZxBxGPkrGNvmZd92voswPNizY7CrUqhmHLu5LCn/KTyRb8jtA/s8+kQ8gLGqXENGf+QQdGtwdA6MFw==',key_name='tempest-keypair-1674601246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_devices' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:10:30 user nova-compute[74903]:   <uuid>b3b4709e-7241-43e6-8300-40efe1b1bb39</uuid>
Nov 06 06:10:30 user nova-compute[74903]:   <name>instance-0000001e</name>
Nov 06 06:10:30 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:10:30 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:10:30 user nova-compute[74903]:   <metadata>
Nov 06 06:10:30 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:10:30 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-68083741</nova:name>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:10:30</nova:creationTime>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:10:30 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:10:30 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:owner>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:user uuid="16796bd87812434689edbdde4d086818">tempest-AttachVolumeShelveTestJSON-1668474455-project-member</nova:user>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:project uuid="371e43fd9d594cd6afca5da129747603">tempest-AttachVolumeShelveTestJSON-1668474455</nova:project>
Nov 06 06:10:30 user nova-compute[74903]:       </nova:owner>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:10:30 user nova-compute[74903]:       <nova:ports>
Nov 06 06:10:30 user nova-compute[74903]:         <nova:port uuid="dbcf41fa-6220-40e4-9937-dfb775d3d257">
Nov 06 06:10:30 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:10:30 user nova-compute[74903]:         </nova:port>
Nov 06 06:10:30 user nova-compute[74903]:       </nova:ports>
Nov 06 06:10:30 user nova-compute[74903]:     </nova:instance>
Nov 06 06:10:30 user nova-compute[74903]:   </metadata>
Nov 06 06:10:30 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:10:30 user nova-compute[74903]:     <system>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="serial">b3b4709e-7241-43e6-8300-40efe1b1bb39</entry>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="uuid">b3b4709e-7241-43e6-8300-40efe1b1bb39</entry>
Nov 06 06:10:30 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:10:30 user nova-compute[74903]:     </system>
Nov 06 06:10:30 user nova-compute[74903]:   </sysinfo>
Nov 06 06:10:30 user nova-compute[74903]:   <os>
Nov 06 06:10:30 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:10:30 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:10:30 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:10:30 user nova-compute[74903]:   </os>
Nov 06 06:10:30 user nova-compute[74903]:   <features>
Nov 06 06:10:30 user nova-compute[74903]:     <acpi/>
Nov 06 06:10:30 user nova-compute[74903]:     <apic/>
Nov 06 06:10:30 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:10:30 user nova-compute[74903]:   </features>
Nov 06 06:10:30 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:10:30 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:10:30 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:10:30 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:10:30 user nova-compute[74903]:   </clock>
Nov 06 06:10:30 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:10:30 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:10:30 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:10:30 user nova-compute[74903]:   </cpu>
Nov 06 06:10:30 user nova-compute[74903]:   <devices>
Nov 06 06:10:30 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:10:30 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:10:30 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk"/>
Nov 06 06:10:30 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:10:30 user nova-compute[74903]:     </disk>
Nov 06 06:10:30 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:10:30 user nova-compute[74903]:       <mac address="fa:16:3e:f7:31:31"/>
Nov 06 06:10:30 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:10:30 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:10:30 user nova-compute[74903]:       <target dev="tapdbcf41fa-62"/>
Nov 06 06:10:30 user nova-compute[74903]:     </interface>
Nov 06 06:10:30 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:10:30 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/console.log" append="off"/>
Nov 06 06:10:30 user nova-compute[74903]:     </serial>
Nov 06 06:10:30 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:10:30 user nova-compute[74903]:     <video>
Nov 06 06:10:30 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:10:30 user nova-compute[74903]:     </video>
Nov 06 06:10:30 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:10:30 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:10:30 user nova-compute[74903]:     </rng>
Nov 06 06:10:30 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:10:30 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:10:30 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:10:30 user nova-compute[74903]:     </memballoon>
Nov 06 06:10:30 user nova-compute[74903]:   </devices>
Nov 06 06:10:30 user nova-compute[74903]: </domain>
Nov 06 06:10:30 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh6eJHL+FCKM86OoBb7Xbywn1oDRpdylkpGOm1nqTP1B/yd47syZxBxGPkrGNvmZd92voswPNizY7CrUqhmHLu5LCn/KTyRb8jtA/s8+kQ8gLGqXENGf+QQdGtwdA6MFw==',key_name='tempest-keypair-1674601246',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG os_vif [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4bd3749-08f4-547b-8d3a-4637db227f56', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbcf41fa-62, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbcf41fa-62, col_values=(('qos', UUID('3ccb3b6a-6806-4174-bfda-ab07d174bd00')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbcf41fa-62, col_values=(('external_ids', {'iface-id': 'dbcf41fa-6220-40e4-9937-dfb775d3d257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:31:31', 'vm-uuid': 'b3b4709e-7241-43e6-8300-40efe1b1bb39'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:30 user nova-compute[74903]: INFO os_vif [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62')
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:10:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No VIF found with MAC fa:16:3e:f7:31:31, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updated VIF entry in instance network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe1b47ef-6007-4ba6-8889-4ae2437b749b req-74e9011f-c4de-4710-a504-6eeb78a458ba service nova] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:32 user nova-compute[74903]: WARNING nova.compute.manager [req-8941fb1f-060c-4e33-857c-420e73c78376 req-d80394ed-6f91-4c9a-a37e-ce2b1d2ca227 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state building and task_state spawning.
Nov 06 06:10:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:35 user nova-compute[74903]: WARNING nova.compute.manager [req-8ea63d72-d1ff-4905-a81d-43c734dec6d9 req-b46de324-7a74-466f-b36f-2ca19621b100 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state building and task_state spawning.
Nov 06 06:10:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:10:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance spawned successfully.
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:10:36 user nova-compute[74903]: INFO nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Took 8.57 seconds to spawn the instance on the hypervisor.
Nov 06 06:10:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:10:36 user nova-compute[74903]: INFO nova.compute.manager [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Took 10.95 seconds to build instance.
Nov 06 06:10:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4c249d2d-8670-44ad-b440-1aa54f2d58e6 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.961s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:44 user nova-compute[74903]: INFO nova.compute.manager [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Terminating instance
Nov 06 06:10:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-69efb497-5680-4444-b460-ae48c35410f6 req-5cd09575-4715-4b20-a9f8-08a9f747f3ca service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-unplugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:10:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Instance destroyed successfully.
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid 457a1716-198e-4054-b665-9e9af54f8c09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1447677904',display_name='tempest-ServerRescueNegativeTestJSON-server-1447677904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1447677904',id=23,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgW7PD81gI6GHkukGSC3wfWAkjxfJo5pr60EENpM4Z2HWRRQosxm5AXbGhgCV2qNZWJWB6YrehuBw7yS4U+q6mCAMU8o1nME88e5r9FVjP00P90vhBUkLBsd9SnMtA+4w==',key_name='tempest-keypair-970855336',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:06:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-wvxbg2po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a651fca6654461c81036f79a46892ef',uuid=457a1716-198e-4054-b665-9e9af54f8c09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "63e0d648-6523-4aa2-8200-7f3e73a45080", "address": "fa:16:3e:a4:d1:48", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63e0d648-65", "ovs_interfaceid": "63e0d648-6523-4aa2-8200-7f3e73a45080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG os_vif [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63e0d648-65, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37f544da-c485-431b-a1bd-de022ff83f65) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:10:45 user nova-compute[74903]: INFO os_vif [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:d1:48,bridge_name='br-int',has_traffic_filtering=True,id=63e0d648-6523-4aa2-8200-7f3e73a45080,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63e0d648-65')
Nov 06 06:10:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Deleting instance files /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09_del
Nov 06 06:10:45 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Deletion of /opt/stack/data/nova/instances/457a1716-198e-4054-b665-9e9af54f8c09_del complete
Nov 06 06:10:45 user nova-compute[74903]: INFO nova.compute.manager [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 06:10:45 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:10:45 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:10:46 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Took 1.23 seconds to deallocate network for instance.
Nov 06 06:10:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-83312050-941e-4b10-aa7c-03780f6bb522 req-05ffb496-367c-423e-9a53-42afe96f9bb0 service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-deleted-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] Acquiring lock "457a1716-198e-4054-b665-9e9af54f8c09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] Lock "457a1716-198e-4054-b665-9e9af54f8c09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] No waiting events found dispatching network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:10:46 user nova-compute[74903]: WARNING nova.compute.manager [req-65b41e64-95ba-4788-a88d-c37feee9d0f4 req-7a936c7e-d68c-4de2-bad2-814244bdbabb service nova] [instance: 457a1716-198e-4054-b665-9e9af54f8c09] Received unexpected event network-vif-plugged-63e0d648-6523-4aa2-8200-7f3e73a45080 for instance with vm_state deleted and task_state None.
Nov 06 06:10:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:10:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:10:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:47 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Deleted allocations for instance 457a1716-198e-4054-b665-9e9af54f8c09
Nov 06 06:10:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c27c8681-b2b4-4a1a-aa0c-51ee8f36e4de tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "457a1716-198e-4054-b665-9e9af54f8c09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.054s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:10:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:10:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Going to confirm migration 2 {{(pid=74903) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquired lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:11:08 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'info_cache' on Instance uuid c907ba0f-9dd8-494a-846d-13758db2fabc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG nova.network.neutron [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [{"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Releasing lock "refresh_cache-c907ba0f-9dd8-494a-846d-13758db2fabc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'migration_context' on Instance uuid c907ba0f-9dd8-494a-846d-13758db2fabc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG nova.objects.base [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Object Instance<c907ba0f-9dd8-494a-846d-13758db2fabc> lazy-loaded attributes: info_cache,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:11:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.507s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:10 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Deleted allocation for migration 3f54c37f-d2e1-4630-82d9-4c04a5427f62
Nov 06 06:11:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fcb7da99-b491-44d4-b999-dd59dfebf93f tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.957s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [{"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-62b95f70-d2ef-4b37-9e0f-2fa8477642de" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:11:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:11:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:17 user nova-compute[74903]: INFO nova.compute.manager [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Terminating instance
Nov 06 06:11:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f0fad23-e889-47b2-9a26-9b52e01bfc31 req-f18551cc-1047-4715-af5e-0730456622dc service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-unplugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:11:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Instance destroyed successfully.
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lazy-loading 'resources' on Instance uuid 3cff20f3-7370-43ad-a050-1cbd107aaf52 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1513746207',display_name='tempest-ServerActionsTestOtherB-server-1513746207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1513746207',id=20,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAmjRPh9ignkccixlDlZjObMtPgFV66/7y3h+2FiXIPSRi+jIaM3VoUfoiVPirPVQIPagymBpj0QHePgHA4K1LPPQE5G3ovQjDtOqZWIrj7ePVX56uhs7O+iSLUo3/sXg==',key_name='tempest-keypair-2160273',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd56e3653ea34efcab24bd58a8b2d6d8',ramdisk_id='',reservation_id='r-dbe51hiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-325946081',owner_user_name='tempest-ServerActionsTestOtherB-325946081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5380e1aa9f6c43dda84e1528cb964a55',uuid=3cff20f3-7370-43ad-a050-1cbd107aaf52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converting VIF {"id": "bd470b96-807a-4d77-8af1-362676fa3552", "address": "fa:16:3e:dd:89:27", "network": {"id": "2509ee6f-7b5b-43d1-b250-2e6cca5a6617", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1124072097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd56e3653ea34efcab24bd58a8b2d6d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd470b96-80", "ovs_interfaceid": "bd470b96-807a-4d77-8af1-362676fa3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_vif [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd470b96-80, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad197d94-300f-47ab-a65d-b8b87c03b192) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:18 user nova-compute[74903]: INFO os_vif [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:27,bridge_name='br-int',has_traffic_filtering=True,id=bd470b96-807a-4d77-8af1-362676fa3552,network=Network(2509ee6f-7b5b-43d1-b250-2e6cca5a6617),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd470b96-80')
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdBANyfC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:11:18 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf13c6d9-d58a-48d8-a6c3-349d308ade71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:11:18 user nova-compute[74903]: No targets found.
Nov 06 06:11:18 user nova-compute[74903]: iSNS:
Nov 06 06:11:18 user nova-compute[74903]: No targets found.
Nov 06 06:11:18 user nova-compute[74903]: STATIC:
Nov 06 06:11:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79
Nov 06 06:11:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:11:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:11:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:11:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:11:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:11:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:11:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:11:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:11:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:11:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:11:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:11:18 user nova-compute[74903]: FIRMWARE:
Nov 06 06:11:18 user nova-compute[74903]: No targets found.
Nov 06 06:11:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:11:18 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:11:18 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b9f766-5e9d-47f9-b559-fc5dc16971b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9cc7db-f5c8-4d92-bc08-229b138d56ad]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:18 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4033f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79'): ({'sde'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Removing single pathed devices sde {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[57953feb-b692-4d68-915f-a7da8c7f21db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf33759-a1d8-4c1d-aec4-125222ba99d8]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Flushing IO for device /dev/sde {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f47f7-3f04-433a-beaa-27287fc823d5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d7bef-25ed-4db8-bbb7-614cffa81f75]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[66567494-ef8a-43bb-87d2-7ceda0bd2f35]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea8e24-b323-47f2-aeab-c066ec56b1c5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260]
Nov 06 06:11:18 user nova-compute[74903]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79, portal: 172.16.0.220,3260] successful.
Nov 06 06:11:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd027d7-2a7e-4487-b862-ced289e35d79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e62b43-01be-49b6-9e7f-b7804b83dd59]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] <== disconnect_volume: return (315ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:11:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Deleting instance files /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_del
Nov 06 06:11:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Deletion of /opt/stack/data/nova/instances/3cff20f3-7370-43ad-a050-1cbd107aaf52_del complete
Nov 06 06:11:18 user nova-compute[74903]: INFO nova.compute.manager [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 06 06:11:18 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:11:18 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:11:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:11:19 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:11:19 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Took 0.79 seconds to deallocate network for instance.
Nov 06 06:11:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:11:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] Acquiring lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] No waiting events found dispatching network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:11:20 user nova-compute[74903]: WARNING nova.compute.manager [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received unexpected event network-vif-plugged-bd470b96-807a-4d77-8af1-362676fa3552 for instance with vm_state active and task_state deleting.
Nov 06 06:11:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-f48fee2f-b763-4b57-abec-b25c7418ee9e req-25039036-cf4d-4166-916d-72d8103af723 service nova] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Received event network-vif-deleted-bd470b96-807a-4d77-8af1-362676fa3552 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:11:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:27 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:11:27 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=25.129512786865234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 3cff20f3-7370-43ad-a050-1cbd107aaf52 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:11:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:11:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:11:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:11:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:45 user nova-compute[74903]: INFO nova.compute.manager [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] [instance: 3cff20f3-7370-43ad-a050-1cbd107aaf52] Took 26.20 seconds to detach 1 volumes for instance.
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKWAZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:11:46 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:11:46 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:11:46 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d951ced-c13d-4fd4-8475-98b984b88b7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:11:46 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6cdfa3-f037-406c-b287-0d67fbf34e1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89] added
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bfdcf4-f2b7-4d24-8465-cd4a7b4acf75]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5735575-0f30-4407-8fc1-9f2640693854]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKWAZb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVrKWAZb" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b7b577-e86e-45fe-a98d-f25282834bfa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVrKWAZb'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e2cec6-bd82-4442-adfe-01c8adbbfa3c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c901119-b287-44f1-91d0-5864af5ba927]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d6f8b-ea41-4b10-a58d-6cfd855bdae0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260]
Nov 06 06:11:46 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260] successful.
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[71253c5d-d6b0-425e-bb29-80320703a538]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ae127-44ae-40dd-bb58-ecd19b83024f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)
Nov 06 06:11:46 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:11:46 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fe50f-c851-42fa-824e-3ae983ddc448]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKWAZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:46 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Deleted allocations for instance 3cff20f3-7370-43ad-a050-1cbd107aaf52
Nov 06 06:11:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca835c85-42c1-452b-b91d-1a23210e32dc tempest-ServerActionsTestOtherB-325946081 tempest-ServerActionsTestOtherB-325946081-project-member] Lock "3cff20f3-7370-43ad-a050-1cbd107aaf52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 29.034s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23735303965363836', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735303965363836', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.objects.instance [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'flavor' on Instance uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:11:47 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:11:47 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:11:47 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:11:47 user nova-compute[74903]:   <serial>71a603de-066e-436f-ba43-b71c7fc15c89</serial>
Nov 06 06:11:47 user nova-compute[74903]: </disk>
Nov 06 06:11:47 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:11:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No VIF found with MAC fa:16:3e:ed:eb:27, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:11:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-40aab7e9-fe44-4bb3-be67-c4310cfd0504 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.890s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: INFO nova.compute.manager [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Detaching volume 71a603de-066e-436f-ba43-b71c7fc15c89
Nov 06 06:11:49 user nova-compute[74903]: INFO nova.virt.block_device [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Attempting to driver detach volume 71a603de-066e-436f-ba43-b71c7fc15c89 from mountpoint /dev/vdb
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Attempting to detach device vdb from instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:11:49 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:11:49 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:11:49 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:11:49 user nova-compute[74903]:   <serial>71a603de-066e-436f-ba43-b71c7fc15c89</serial>
Nov 06 06:11:49 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:11:49 user nova-compute[74903]: </disk>
Nov 06 06:11:49 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:11:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully detached device vdb from instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 from the persistent domain config.
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:11:49 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:11:49 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:11:49 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:11:49 user nova-compute[74903]:   <serial>71a603de-066e-436f-ba43-b71c7fc15c89</serial>
Nov 06 06:11:49 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:11:49 user nova-compute[74903]: </disk>
Nov 06 06:11:49 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 00426b5a-c105-48da-ab5f-82f04a4dd090 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid c907ba0f-9dd8-494a-846d-13758db2fabc {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:11:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:11:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:05 user nova-compute[74903]: INFO nova.compute.manager [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Unrescuing
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquired lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating instance_info_cache with network_info: [{"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Releasing lock "refresh_cache-f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'flavor' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:05 user nova-compute[74903]: WARNING nova.compute.manager [req-4ea7f4de-01bf-4143-9f1d-68cce1468b12 req-e0560203-0472-479c-9860-7fd772375d90 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:12:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:06 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance destroyed successfully.
Nov 06 06:12:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:08 user nova-compute[74903]: WARNING nova.compute.manager [req-c62c4d6b-6ede-4bcd-862a-35528944608b req-8865a1e8-39be-468e-b5e6-37c32b5ee8d0 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:12:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:09 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 is timed out.
Nov 06 06:12:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully detached device vdb from instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 from the live domain config.
Nov 06 06:12:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVrKWAZb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:12:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83618390-c780-4dfc-82c1-be3ea222e3c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:12:09 user nova-compute[74903]: No targets found.
Nov 06 06:12:09 user nova-compute[74903]: iSNS:
Nov 06 06:12:09 user nova-compute[74903]: No targets found.
Nov 06 06:12:09 user nova-compute[74903]: STATIC:
Nov 06 06:12:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89
Nov 06 06:12:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:12:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:12:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:12:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:12:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:12:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:12:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:12:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:12:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:12:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:12:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:12:09 user nova-compute[74903]: FIRMWARE:
Nov 06 06:12:09 user nova-compute[74903]: No targets found.
Nov 06 06:12:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:12:09 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:12:09 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38cbea-f2f0-4e1e-a23a-fbe5539948d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa55b95-10c3-4b43-be2c-47a257e33c5f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:12:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 (non-flash)
Nov 06 06:12:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:12:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28628dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ba61f2-d7db-4935-a194-dc95884dc19d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[98066ae5-1715-401f-b794-82cc3d7f3faa]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0e5e7-d19e-4f84-82e0-8842f77b09fc]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:12:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[10759875-a388-411b-b998-b17dc7cea5eb]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af0212-7c74-4538-ab6f-6893a9bb9f93]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1969a86f-4c94-4091-91a3-f3d2c8bd9d07 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a20c9d-0b73-4497-a8ae-5d2289d845b5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260]
Nov 06 06:12:10 user nova-compute[74903]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89, portal: 172.16.0.220,3260] successful.
Nov 06 06:12:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:10 user nova-compute[74903]: WARNING nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:10 user nova-compute[74903]: WARNING nova.compute.manager [req-b4c55400-c219-46fe-b1af-9fe999c9b19a req-3620ec39-04d3-48c0-83d7-6b405a09828d service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71a603de-066e-436f-ba43-b71c7fc15c89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9418a64f-d6bf-44b1-900f-ddbbbc031415]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] <== disconnect_volume: return (390ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:12:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:12:11 user nova-compute[74903]: DEBUG nova.objects.instance [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'flavor' on Instance uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-385ae0a7-10e3-461d-92ec-3c9426437ffc tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.390s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [{"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-f023ad69-b053-4fae-a05a-dc66bbd76bfc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing instance network info cache due to event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:12:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updated VIF entry in instance network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:12:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d1f2f30-efc1-4d79-8ec9-998d08ec202a req-31e9ea54-e03b-4b96-9fc5-4963d06f887a service nova] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:20 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:12:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:23 user nova-compute[74903]: INFO nova.compute.manager [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Shelving
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:24 user nova-compute[74903]: WARNING nova.compute.manager [req-fb09288b-1bfd-4811-802b-34ebe59d0301 req-bdeef68d-4656-42a8-a163-e5cc2f5ef698 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state active and task_state shelving.
Nov 06 06:12:24 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance destroyed successfully.
Nov 06 06:12:24 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Beginning cold snapshot process
Nov 06 06:12:24 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:12:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk /opt/stack/data/nova/instances/snapshots/tmpqjp5zvul/ef5497b7c9704a3baaa2d3cdc40fb32b {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk /opt/stack/data/nova/instances/snapshots/tmpqjp5zvul/ef5497b7c9704a3baaa2d3cdc40fb32b" returned: 0 in 0.642s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:25 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Snapshot extracted, beginning image upload
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:26 user nova-compute[74903]: WARNING nova.compute.manager [req-1655ad44-4a0d-43b3-b0df-f1e9666fe9f7 req-84ddf20a-803f-462b-b060-64ac45163e71 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state active and task_state shelving_image_uploading.
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:12:27 user nova-compute[74903]: INFO nova.compute.claims [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Claim successful on node user
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:12:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.policy [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73771ca807e0483caa58fcd0a84b95ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8edf9bd5d4024967a74ab3c6c90fb965', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:12:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Creating image(s)
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "/opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "/opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "/opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Snapshot image upload complete
Nov 06 06:12:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:28 user nova-compute[74903]: INFO nova.compute.manager [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Shelve offloading
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Successfully created port: 83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.644s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.092193603515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance destroyed successfully.
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f023ad69-b053-4fae-a05a-dc66bbd76bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk 1073741824" returned: 0 in 0.057s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:12:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Cannot resize image /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Ensure instance console log exists: /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.736s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Successfully updated port: 83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquired lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-changed-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Refreshing instance network info cache due to event network-changed-83e28abd-342f-4933-b5c1-dd8280545312. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] Acquiring lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updating instance_info_cache with network_info: [{"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Releasing lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Instance network_info: |[{"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] Acquired lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Refreshing network info cache for port 83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Start _get_guest_xml network_info=[{"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:12:31 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:31 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1273966',id=31,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUZ4qY4i+UEX+RPSMwM5W4KwahGyljIciMHj+0tFU0SzevTl4vAxDr6XzXboVB1GxKAzeDwtWcNzCUUUAR4guwFyDNfrKKShCcKes1lBzz7iK0rcq0jBwYVgaYdzqHQMg==',key_name='tempest-keypair-666108101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8edf9bd5d4024967a74ab3c6c90fb965',ramdisk_id='',reservation_id='r-gff4ub0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73771ca807e0483caa58fcd0a84b95ff',uuid=eed2efe8-e995-4dd7-bf6d-fd70c7801728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converting VIF {"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lazy-loading 'pci_devices' on Instance uuid eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:12:31 user nova-compute[74903]:   <uuid>eed2efe8-e995-4dd7-bf6d-fd70c7801728</uuid>
Nov 06 06:12:31 user nova-compute[74903]:   <name>instance-0000001f</name>
Nov 06 06:12:31 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:12:31 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:12:31 user nova-compute[74903]:   <metadata>
Nov 06 06:12:31 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:12:31 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092</nova:name>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:12:31</nova:creationTime>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:12:31 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:12:31 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:owner>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:user uuid="73771ca807e0483caa58fcd0a84b95ff">tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member</nova:user>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:project uuid="8edf9bd5d4024967a74ab3c6c90fb965">tempest-TestServerVolumeAttachScenarioOldVersion-84580362</nova:project>
Nov 06 06:12:31 user nova-compute[74903]:       </nova:owner>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:12:31 user nova-compute[74903]:       <nova:ports>
Nov 06 06:12:31 user nova-compute[74903]:         <nova:port uuid="83e28abd-342f-4933-b5c1-dd8280545312">
Nov 06 06:12:31 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 06:12:31 user nova-compute[74903]:         </nova:port>
Nov 06 06:12:31 user nova-compute[74903]:       </nova:ports>
Nov 06 06:12:31 user nova-compute[74903]:     </nova:instance>
Nov 06 06:12:31 user nova-compute[74903]:   </metadata>
Nov 06 06:12:31 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:12:31 user nova-compute[74903]:     <system>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="serial">eed2efe8-e995-4dd7-bf6d-fd70c7801728</entry>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="uuid">eed2efe8-e995-4dd7-bf6d-fd70c7801728</entry>
Nov 06 06:12:31 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:12:31 user nova-compute[74903]:     </system>
Nov 06 06:12:31 user nova-compute[74903]:   </sysinfo>
Nov 06 06:12:31 user nova-compute[74903]:   <os>
Nov 06 06:12:31 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:12:31 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:12:31 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:12:31 user nova-compute[74903]:   </os>
Nov 06 06:12:31 user nova-compute[74903]:   <features>
Nov 06 06:12:31 user nova-compute[74903]:     <acpi/>
Nov 06 06:12:31 user nova-compute[74903]:     <apic/>
Nov 06 06:12:31 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:12:31 user nova-compute[74903]:   </features>
Nov 06 06:12:31 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:12:31 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:12:31 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:12:31 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:12:31 user nova-compute[74903]:   </clock>
Nov 06 06:12:31 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:12:31 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:12:31 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:12:31 user nova-compute[74903]:   </cpu>
Nov 06 06:12:31 user nova-compute[74903]:   <devices>
Nov 06 06:12:31 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:12:31 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:12:31 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk"/>
Nov 06 06:12:31 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:12:31 user nova-compute[74903]:     </disk>
Nov 06 06:12:31 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:12:31 user nova-compute[74903]:       <mac address="fa:16:3e:45:f7:b1"/>
Nov 06 06:12:31 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:12:31 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:12:31 user nova-compute[74903]:       <target dev="tap83e28abd-34"/>
Nov 06 06:12:31 user nova-compute[74903]:     </interface>
Nov 06 06:12:31 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:12:31 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/console.log" append="off"/>
Nov 06 06:12:31 user nova-compute[74903]:     </serial>
Nov 06 06:12:31 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:12:31 user nova-compute[74903]:     <video>
Nov 06 06:12:31 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:12:31 user nova-compute[74903]:     </video>
Nov 06 06:12:31 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:12:31 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:12:31 user nova-compute[74903]:     </rng>
Nov 06 06:12:31 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:12:31 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:12:31 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:12:31 user nova-compute[74903]:     </memballoon>
Nov 06 06:12:31 user nova-compute[74903]:   </devices>
Nov 06 06:12:31 user nova-compute[74903]: </domain>
Nov 06 06:12:31 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1273966',id=31,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUZ4qY4i+UEX+RPSMwM5W4KwahGyljIciMHj+0tFU0SzevTl4vAxDr6XzXboVB1GxKAzeDwtWcNzCUUUAR4guwFyDNfrKKShCcKes1lBzz7iK0rcq0jBwYVgaYdzqHQMg==',key_name='tempest-keypair-666108101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8edf9bd5d4024967a74ab3c6c90fb965',ramdisk_id='',reservation_id='r-gff4ub0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73771ca807e0483caa58fcd0a84b95ff',uuid=eed2efe8-e995-4dd7-bf6d-fd70c7801728,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converting VIF {"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG os_vif [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c93846a-ba3f-5e41-b945-b5bd2cbd22f9', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83e28abd-34, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83e28abd-34, col_values=(('qos', UUID('01593cb3-dc6c-47d9-8981-68e504d3b09d')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83e28abd-34, col_values=(('external_ids', {'iface-id': '83e28abd-342f-4933-b5c1-dd8280545312', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:f7:b1', 'vm-uuid': 'eed2efe8-e995-4dd7-bf6d-fd70c7801728'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: INFO os_vif [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34')
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] No VIF found with MAC fa:16:3e:45:f7:b1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:12:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance destroyed successfully.
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'resources' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh6eJHL+FCKM86OoBb7Xbywn1oDRpdylkpGOm1nqTP1B/yd47syZxBxGPkrGNvmZd92voswPNizY7CrUqhmHLu5LCn/KTyRb8jtA/s8+kQ8gLGqXENGf+QQdGtwdA6MFw==',key_name='tempest-keypair-1674601246',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:12:28.857722',shelved_host='user',shelved_image_id='c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG os_vif [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbcf41fa-62, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ccb3b6a-6806-4174-bfda-ab07d174bd00) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: INFO os_vif [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62')
Nov 06 06:12:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Deleting instance files /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39_del
Nov 06 06:12:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Deletion of /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39_del complete
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Deleted allocations for instance b3b4709e-7241-43e6-8300-40efe1b1bb39
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:31 user nova-compute[74903]: INFO nova.compute.manager [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Terminating instance
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'numa_topology' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.objects.base [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<b3b4709e-7241-43e6-8300-40efe1b1bb39> lazy-loaded attributes: resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updated VIF entry in instance network info cache for port 83e28abd-342f-4933-b5c1-dd8280545312. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updating instance_info_cache with network_info: [{"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aee37c08-faec-40a9-80b5-0d8dcfd8f2c4 req-e0c1c1fd-c7f9-4aa4-8b43-6e0b2613b227 service nova] Releasing lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0a883818-5ac8-4427-b291-1fbdafaf5d7f tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.638s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-unplugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Acquiring lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] No waiting events found dispatching network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:32 user nova-compute[74903]: WARNING nova.compute.manager [req-34447df5-9e53-42a2-b842-05be0425411b req-84563e93-80c4-4e2c-bfcb-4e7a2ac5cf14 service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received unexpected event network-vif-plugged-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f for instance with vm_state rescued and task_state deleting.
Nov 06 06:12:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Instance destroyed successfully.
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid f023ad69-b053-4fae-a05a-dc66bbd76bfc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-707951993',display_name='tempest-ServerRescueNegativeTestJSON-server-707951993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-707951993',id=5,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:57:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-rbt5057z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:57:09Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=f023ad69-b053-4fae-a05a-dc66bbd76bfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "address": "fa:16:3e:70:d6:fd", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fa5c41-e0", "ovs_interfaceid": "f2fa5c41-e062-4b4a-aaa2-95dcad72c58f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG os_vif [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2fa5c41-e0, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99ff1810-f06e-41e1-a926-24d237db29f0) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: INFO os_vif [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:d6:fd,bridge_name='br-int',has_traffic_filtering=True,id=f2fa5c41-e062-4b4a-aaa2-95dcad72c58f,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fa5c41-e0')
Nov 06 06:12:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Deleting instance files /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc_del
Nov 06 06:12:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Deletion of /opt/stack/data/nova/instances/f023ad69-b053-4fae-a05a-dc66bbd76bfc_del complete
Nov 06 06:12:33 user nova-compute[74903]: INFO nova.compute.manager [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 06 06:12:33 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] No waiting events found dispatching network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:33 user nova-compute[74903]: WARNING nova.compute.manager [req-524f6602-2f32-4c53-816c-33df1695d8bf req-4c1a6cdb-63e5-4bde-832a-779c997e4a9c service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received unexpected event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 for instance with vm_state building and task_state spawning.
Nov 06 06:12:34 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:34 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Took 1.03 seconds to deallocate network for instance.
Nov 06 06:12:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:34 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Deleted allocations for instance f023ad69-b053-4fae-a05a-dc66bbd76bfc
Nov 06 06:12:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fb8c3ae2-146e-4b2b-a63e-d9e5b18674dc tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "f023ad69-b053-4fae-a05a-dc66bbd76bfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.031s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-9e722d2b-90a0-48bb-a4cf-3e07d232bd70 req-bbe0d817-1f2a-44ae-8779-8c7041f9f21c service nova] [instance: f023ad69-b053-4fae-a05a-dc66bbd76bfc] Received event network-vif-deleted-f2fa5c41-e062-4b4a-aaa2-95dcad72c58f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] No waiting events found dispatching network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:35 user nova-compute[74903]: WARNING nova.compute.manager [req-13e6acd5-97d9-4958-a453-ec54ce164f26 req-8396338b-9e33-4d75-bafb-d8741d2d9973 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received unexpected event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 for instance with vm_state building and task_state spawning.
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:12:35 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Instance spawned successfully.
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:36 user nova-compute[74903]: INFO nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Took 7.26 seconds to spawn the instance on the hypervisor.
Nov 06 06:12:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:12:36 user nova-compute[74903]: INFO nova.compute.manager [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Took 8.79 seconds to build instance.
Nov 06 06:12:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e5887232-cc62-4913-be32-37d6eee407ef tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.060s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:12:40 user nova-compute[74903]: INFO nova.compute.claims [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Claim successful on node user
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:12:41 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.policy [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a284ec2f23734152a20aeb9658e08f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a48326e9015488594cdc613e41c7737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:12:41 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Creating image(s)
Nov 06 06:12:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "/opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "/opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "/opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.218s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk 1073741824" returned: 0 in 0.062s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.304s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Successfully created port: 42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Cannot resize image /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Ensure instance console log exists: /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Successfully updated port: 42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquired lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-changed-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Refreshing instance network info cache due to event network-changed-42721555-cfdc-4549-89d7-b6f2ec834286. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] Acquiring lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:12:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.neutron [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Updating instance_info_cache with network_info: [{"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Releasing lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Instance network_info: |[{"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] Acquired lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.neutron [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Refreshing network info cache for port 42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Start _get_guest_xml network_info=[{"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:12:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396562724',display_name='tempest-VolumesAdminNegativeTest-server-1396562724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396562724',id=32,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-754b40lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:12:42Z,user_data=None,user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=2725665f-e47b-4f6b-97c8-e74f0f6f4b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'pci_devices' on Instance uuid 2725665f-e47b-4f6b-97c8-e74f0f6f4b31 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:12:44 user nova-compute[74903]:   <uuid>2725665f-e47b-4f6b-97c8-e74f0f6f4b31</uuid>
Nov 06 06:12:44 user nova-compute[74903]:   <name>instance-00000020</name>
Nov 06 06:12:44 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:12:44 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:12:44 user nova-compute[74903]:   <metadata>
Nov 06 06:12:44 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:12:44 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1396562724</nova:name>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:12:44</nova:creationTime>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:12:44 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:12:44 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:owner>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:user uuid="a284ec2f23734152a20aeb9658e08f5c">tempest-VolumesAdminNegativeTest-55869565-project-member</nova:user>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:project uuid="2a48326e9015488594cdc613e41c7737">tempest-VolumesAdminNegativeTest-55869565</nova:project>
Nov 06 06:12:44 user nova-compute[74903]:       </nova:owner>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:12:44 user nova-compute[74903]:       <nova:ports>
Nov 06 06:12:44 user nova-compute[74903]:         <nova:port uuid="42721555-cfdc-4549-89d7-b6f2ec834286">
Nov 06 06:12:44 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:12:44 user nova-compute[74903]:         </nova:port>
Nov 06 06:12:44 user nova-compute[74903]:       </nova:ports>
Nov 06 06:12:44 user nova-compute[74903]:     </nova:instance>
Nov 06 06:12:44 user nova-compute[74903]:   </metadata>
Nov 06 06:12:44 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:12:44 user nova-compute[74903]:     <system>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="serial">2725665f-e47b-4f6b-97c8-e74f0f6f4b31</entry>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="uuid">2725665f-e47b-4f6b-97c8-e74f0f6f4b31</entry>
Nov 06 06:12:44 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:12:44 user nova-compute[74903]:     </system>
Nov 06 06:12:44 user nova-compute[74903]:   </sysinfo>
Nov 06 06:12:44 user nova-compute[74903]:   <os>
Nov 06 06:12:44 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:12:44 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:12:44 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:12:44 user nova-compute[74903]:   </os>
Nov 06 06:12:44 user nova-compute[74903]:   <features>
Nov 06 06:12:44 user nova-compute[74903]:     <acpi/>
Nov 06 06:12:44 user nova-compute[74903]:     <apic/>
Nov 06 06:12:44 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:12:44 user nova-compute[74903]:   </features>
Nov 06 06:12:44 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:12:44 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:12:44 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:12:44 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:12:44 user nova-compute[74903]:   </clock>
Nov 06 06:12:44 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:12:44 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:12:44 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:12:44 user nova-compute[74903]:   </cpu>
Nov 06 06:12:44 user nova-compute[74903]:   <devices>
Nov 06 06:12:44 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:12:44 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:12:44 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk"/>
Nov 06 06:12:44 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:12:44 user nova-compute[74903]:     </disk>
Nov 06 06:12:44 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:12:44 user nova-compute[74903]:       <mac address="fa:16:3e:b4:76:42"/>
Nov 06 06:12:44 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:12:44 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:12:44 user nova-compute[74903]:       <target dev="tap42721555-cf"/>
Nov 06 06:12:44 user nova-compute[74903]:     </interface>
Nov 06 06:12:44 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:12:44 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/console.log" append="off"/>
Nov 06 06:12:44 user nova-compute[74903]:     </serial>
Nov 06 06:12:44 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:12:44 user nova-compute[74903]:     <video>
Nov 06 06:12:44 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:12:44 user nova-compute[74903]:     </video>
Nov 06 06:12:44 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:12:44 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:12:44 user nova-compute[74903]:     </rng>
Nov 06 06:12:44 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:12:44 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:12:44 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:12:44 user nova-compute[74903]:     </memballoon>
Nov 06 06:12:44 user nova-compute[74903]:   </devices>
Nov 06 06:12:44 user nova-compute[74903]: </domain>
Nov 06 06:12:44 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396562724',display_name='tempest-VolumesAdminNegativeTest-server-1396562724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396562724',id=32,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-754b40lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:12:42Z,user_data=None,user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=2725665f-e47b-4f6b-97c8-e74f0f6f4b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG os_vif [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '984b000e-fae3-54d2-aa9f-c28d031cc6a0', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42721555-cf, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42721555-cf, col_values=(('qos', UUID('4cce1bdc-b3af-48ad-8a08-7be453593d2e')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42721555-cf, col_values=(('external_ids', {'iface-id': '42721555-cfdc-4549-89d7-b6f2ec834286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:76:42', 'vm-uuid': '2725665f-e47b-4f6b-97c8-e74f0f6f4b31'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:44 user nova-compute[74903]: INFO os_vif [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf')
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] No VIF found with MAC fa:16:3e:b4:76:42, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.neutron [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Updated VIF entry in instance network info cache for port 42721555-cfdc-4549-89d7-b6f2ec834286. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG nova.network.neutron [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Updating instance_info_cache with network_info: [{"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:12:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f1126440-616c-4430-89b6-cdb7caba03ec req-7d06ad35-1d96-4d1e-ad42-0dfd80790515 service nova] Releasing lock "refresh_cache-2725665f-e47b-4f6b-97c8-e74f0f6f4b31" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:12:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] No waiting events found dispatching network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:46 user nova-compute[74903]: WARNING nova.compute.manager [req-c2fcc852-2ccb-4577-b5ca-5d93dabb723e req-737effd5-6ecd-49c7-8013-8ff29173067f service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received unexpected event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 for instance with vm_state building and task_state spawning.
Nov 06 06:12:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] No waiting events found dispatching network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:12:48 user nova-compute[74903]: WARNING nova.compute.manager [req-d6b2ed3f-d6d7-4c50-bf8f-9c1a310ffbc5 req-6f3a9263-2b2b-4b6e-add8-ddc408a39c3c service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received unexpected event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 for instance with vm_state building and task_state spawning.
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:12:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Instance spawned successfully.
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:12:48 user nova-compute[74903]: INFO nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Took 6.61 seconds to spawn the instance on the hypervisor.
Nov 06 06:12:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:12:48 user nova-compute[74903]: INFO nova.compute.manager [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Took 7.52 seconds to build instance.
Nov 06 06:12:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-83cd1520-672a-4647-8d50-22f9b1e4690e tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.639s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:12:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:59 user nova-compute[74903]: INFO nova.compute.manager [None req-7145f67b-c700-44f2-8db6-5e8e021b5c2b tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Get console output
Nov 06 06:12:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:12:59 user nova-compute[74903]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 06 06:13:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:13:15 user nova-compute[74903]: INFO nova.compute.claims [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Claim successful on node user
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:13:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.policy [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ab10b231ebe451e90c8b8b2583bfc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c457df19cfa497e839b005243324307', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:13:15 user nova-compute[74903]: INFO nova.virt.block_device [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Booting with volume f5099a81-297c-4ddd-afbc-3767e9f86892 at /dev/vda
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.utils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1349a4-a504-43e4-9000-833ef59417aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eeeab6-f2ae-4890-9cea-19cd8b3048ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b381a56-f5e3-490f-90f2-71f4fd41232a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c734269-9e64-409a-aa32-3417cdd8b4e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:13:15 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:13:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[514e8c1e-c3b9-4e19-85ae-140bfcf38438]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG os_brick.utils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:13:15 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating existing volume attachment record: 8b80211c-243a-4b69-83d3-c70930d153b6 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Successfully created port: dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:13:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [{"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-00426b5a-c105-48da-ab5f-82f04a4dd090" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Successfully updated port: dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquired lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-changed-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Refreshing instance network info cache due to event network-changed-dc00fca4-8c23-4173-a597-8781b02a66b9. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] Acquiring lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating instance_info_cache with network_info: [{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Releasing lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance network_info: |[{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] Acquired lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:13:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Refreshing network info cache for port dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:13:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updated VIF entry in instance network info cache for port dc00fca4-8c23-4173-a597-8781b02a66b9. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:13:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating instance_info_cache with network_info: [{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:13:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-679de73d-ac53-48dd-a95d-3955ef33c718 req-2291a01e-1aef-4565-a34c-1300b7ec3603 service nova] Releasing lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:13:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:13:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:22 user nova-compute[74903]: INFO nova.compute.manager [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Terminating instance
Nov 06 06:13:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a637fe4-c94e-4ad2-b251-13387b591059 req-fc7d2945-02a7-48fb-bd9e-81b7818dac58 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-unplugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:13:23 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Instance destroyed successfully.
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.objects.instance [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lazy-loading 'resources' on Instance uuid 62b95f70-d2ef-4b37-9e0f-2fa8477642de {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1277920532',display_name='tempest-ServerRescueNegativeTestJSON-server-1277920532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1277920532',id=3,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:00:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8cbdaee9b7f4323a120240fef7ea443',ramdisk_id='',reservation_id='r-5ylx3b5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-21945873',owner_user_name='tempest-ServerRescueNegativeTestJSON-21945873-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:01:57Z,user_data=None,user_id='4a651fca6654461c81036f79a46892ef',uuid=62b95f70-d2ef-4b37-9e0f-2fa8477642de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converting VIF {"id": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "address": "fa:16:3e:6c:4c:c1", "network": {"id": "39a5b305-26f9-4784-9052-6f3ed4cb6400", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1405197456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8cbdaee9b7f4323a120240fef7ea443", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f5f3d5-a0", "ovs_interfaceid": "82f5f3d5-a09c-4e30-a784-c9bab97400ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG os_vif [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82f5f3d5-a0, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d310bf6-1d7c-43a9-99e9-c0b7f7992592) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:23 user nova-compute[74903]: INFO os_vif [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:4c:c1,bridge_name='br-int',has_traffic_filtering=True,id=82f5f3d5-a09c-4e30-a784-c9bab97400ab,network=Network(39a5b305-26f9-4784-9052-6f3ed4cb6400),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f5f3d5-a0')
Nov 06 06:13:23 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Deleting instance files /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de_del
Nov 06 06:13:23 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Deletion of /opt/stack/data/nova/instances/62b95f70-d2ef-4b37-9e0f-2fa8477642de_del complete
Nov 06 06:13:23 user nova-compute[74903]: INFO nova.compute.manager [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 06:13:23 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:13:23 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Took 0.49 seconds to deallocate network for instance.
Nov 06 06:13:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:24 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Deleted allocations for instance 62b95f70-d2ef-4b37-9e0f-2fa8477642de
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-38471f85-fe3e-414d-b181-b90cb79a1a3a tempest-ServerRescueNegativeTestJSON-21945873 tempest-ServerRescueNegativeTestJSON-21945873-project-member] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] Acquiring lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] Lock "62b95f70-d2ef-4b37-9e0f-2fa8477642de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] No waiting events found dispatching network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:24 user nova-compute[74903]: WARNING nova.compute.manager [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received unexpected event network-vif-plugged-82f5f3d5-a09c-4e30-a784-c9bab97400ab for instance with vm_state deleted and task_state None.
Nov 06 06:13:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-cca61f0a-e446-4a7f-a79b-fd2f743f329e req-5015b971-8d24-4c72-b1cb-a96e1982f723 service nova] [instance: 62b95f70-d2ef-4b37-9e0f-2fa8477642de] Received event network-vif-deleted-82f5f3d5-a09c-4e30-a784-c9bab97400ab {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:13:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:13:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.07530975341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c907ba0f-9dd8-494a-846d-13758db2fabc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 2725665f-e47b-4f6b-97c8-e74f0f6f4b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 82322fae-3f99-4324-b0b3-3098f01f87fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:13:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:13:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:13:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Creating image(s)
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Ensure instance console log exists: /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start _get_guest_xml network_info=[{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82322fae-3f99-4324-b0b3-3098f01f87fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5099a81-297c-4ddd-afbc-3767e9f86892', 'serial': 'f5099a81-297c-4ddd-afbc-3767e9f86892'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '8b80211c-243a-4b69-83d3-c70930d153b6', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:13:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:13:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:13:38 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:13:38 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:13:38 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b75807-5b21-463e-8f30-ba98ed88b4fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:13:38 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a54fe-9556-4504-a347-fe140af1db32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892] added
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327fba2-dd74-47c6-b34e-b381156c0562]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c75fa9-0d0f-45e1-9e9e-66b9b93a4027]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKNuXxdC {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKNuXxdC" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[82995256-b1ca-4ea6-b7e5-0c817846b1c9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKNuXxdC'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fc7d88-0427-4810-bd33-c507305d14b6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[14777857-5400-4907-b887-5f7d9b187d4d]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eeb64b-6954-43f7-a4b5-82e425ddff6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]
Nov 06 06:13:38 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f7c73-5a37-467d-bbeb-17617681b3d1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[07324dc2-66c0-40b7-b74c-58e9e24f5d7f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:13:38 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a12a54-3805-44e5-a433-e53f45a12628]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26264663262323632', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264663262323632', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930734297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:13:39 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.objects.instance [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lazy-loading 'pci_devices' on Instance uuid 82322fae-3f99-4324-b0b3-3098f01f87fa {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:13:40 user nova-compute[74903]:   <uuid>82322fae-3f99-4324-b0b3-3098f01f87fa</uuid>
Nov 06 06:13:40 user nova-compute[74903]:   <name>instance-00000021</name>
Nov 06 06:13:40 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:13:40 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:13:40 user nova-compute[74903]:   <metadata>
Nov 06 06:13:40 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:13:40 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:13:40 user nova-compute[74903]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1930734297</nova:name>
Nov 06 06:13:40 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:13:38</nova:creationTime>
Nov 06 06:13:40 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:13:40 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:13:40 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:13:40 user nova-compute[74903]:       <nova:owner>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:user uuid="4ab10b231ebe451e90c8b8b2583bfc91">tempest-ServerActionsV293TestJSON-692224141-project-member</nova:user>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:project uuid="9c457df19cfa497e839b005243324307">tempest-ServerActionsV293TestJSON-692224141</nova:project>
Nov 06 06:13:40 user nova-compute[74903]:       </nova:owner>
Nov 06 06:13:40 user nova-compute[74903]:       <nova:ports>
Nov 06 06:13:40 user nova-compute[74903]:         <nova:port uuid="dc00fca4-8c23-4173-a597-8781b02a66b9">
Nov 06 06:13:40 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 06:13:40 user nova-compute[74903]:         </nova:port>
Nov 06 06:13:40 user nova-compute[74903]:       </nova:ports>
Nov 06 06:13:40 user nova-compute[74903]:     </nova:instance>
Nov 06 06:13:40 user nova-compute[74903]:   </metadata>
Nov 06 06:13:40 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:13:40 user nova-compute[74903]:     <system>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="serial">82322fae-3f99-4324-b0b3-3098f01f87fa</entry>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="uuid">82322fae-3f99-4324-b0b3-3098f01f87fa</entry>
Nov 06 06:13:40 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:13:40 user nova-compute[74903]:     </system>
Nov 06 06:13:40 user nova-compute[74903]:   </sysinfo>
Nov 06 06:13:40 user nova-compute[74903]:   <os>
Nov 06 06:13:40 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:13:40 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:13:40 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:13:40 user nova-compute[74903]:   </os>
Nov 06 06:13:40 user nova-compute[74903]:   <features>
Nov 06 06:13:40 user nova-compute[74903]:     <acpi/>
Nov 06 06:13:40 user nova-compute[74903]:     <apic/>
Nov 06 06:13:40 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:13:40 user nova-compute[74903]:   </features>
Nov 06 06:13:40 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:13:40 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:13:40 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:13:40 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:13:40 user nova-compute[74903]:   </clock>
Nov 06 06:13:40 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:13:40 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:13:40 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:13:40 user nova-compute[74903]:   </cpu>
Nov 06 06:13:40 user nova-compute[74903]:   <devices>
Nov 06 06:13:40 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:13:40 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:13:40 user nova-compute[74903]:       <source dev="/dev/sdc"/>
Nov 06 06:13:40 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:13:40 user nova-compute[74903]:       <serial>f5099a81-297c-4ddd-afbc-3767e9f86892</serial>
Nov 06 06:13:40 user nova-compute[74903]:     </disk>
Nov 06 06:13:40 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:13:40 user nova-compute[74903]:       <mac address="fa:16:3e:cb:98:5d"/>
Nov 06 06:13:40 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:13:40 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:13:40 user nova-compute[74903]:       <target dev="tapdc00fca4-8c"/>
Nov 06 06:13:40 user nova-compute[74903]:     </interface>
Nov 06 06:13:40 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:13:40 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa/console.log" append="off"/>
Nov 06 06:13:40 user nova-compute[74903]:     </serial>
Nov 06 06:13:40 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:13:40 user nova-compute[74903]:     <video>
Nov 06 06:13:40 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:13:40 user nova-compute[74903]:     </video>
Nov 06 06:13:40 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:13:40 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:13:40 user nova-compute[74903]:     </rng>
Nov 06 06:13:40 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:13:40 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:13:40 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:13:40 user nova-compute[74903]:     </memballoon>
Nov 06 06:13:40 user nova-compute[74903]:   </devices>
Nov 06 06:13:40 user nova-compute[74903]: </domain>
Nov 06 06:13:40 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1930734297',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:13:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG os_vif [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '907ce680-e355-564e-bc48-aaac3e02ab9a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc00fca4-8c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc00fca4-8c, col_values=(('qos', UUID('e722e5df-b448-44f1-8446-a0b0097bc18f')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc00fca4-8c, col_values=(('external_ids', {'iface-id': 'dc00fca4-8c23-4173-a597-8781b02a66b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:98:5d', 'vm-uuid': '82322fae-3f99-4324-b0b3-3098f01f87fa'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:40 user nova-compute[74903]: INFO os_vif [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c')
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:13:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] No VIF found with MAC fa:16:3e:cb:98:5d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:41 user nova-compute[74903]: WARNING nova.compute.manager [req-03c26124-7e8c-4c59-bab7-57bdc6e2ef00 req-28cf6981-b5b9-4b86-bc32-602f7a43d41a service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state building and task_state spawning.
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:13:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance spawned successfully.
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.compute.manager [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:43 user nova-compute[74903]: WARNING nova.compute.manager [req-d8642db2-1a54-4396-98e5-b3c93defabae req-3024cc0f-6323-49c9-a9ed-785d380e1be4 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state building and task_state spawning.
Nov 06 06:13:43 user nova-compute[74903]: INFO nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 06 06:13:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:13:43 user nova-compute[74903]: INFO nova.compute.manager [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Took 28.76 seconds to build instance.
Nov 06 06:13:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-57d0e7b4-b7b7-46fc-b979-b991b2e935a4 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.891s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:55 user nova-compute[74903]: INFO nova.compute.manager [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Terminating instance
Nov 06 06:13:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-5a61612a-5612-4929-8989-1ab3472add8b req-9351b2f0-5b71-4e73-83ab-af4139d64c5a service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-unplugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Instance destroyed successfully.
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.objects.instance [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid f07c272e-7eb5-485a-8ad7-c15b9a1be2c1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-117646916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-117646916',id=28,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:10:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-eefndi30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:12:10Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=f07c272e-7eb5-485a-8ad7-c15b9a1be2c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "address": "fa:16:3e:89:db:1a", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae056fd7-a4", "ovs_interfaceid": "ae056fd7-a484-4ed4-b25f-8671ed4df9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_vif [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae056fd7-a4, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b01257ac-c3ef-4373-9ae6-6ca2c6f7a8f8) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:13:56 user nova-compute[74903]: INFO os_vif [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:db:1a,bridge_name='br-int',has_traffic_filtering=True,id=ae056fd7-a484-4ed4-b25f-8671ed4df9b6,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae056fd7-a4')
Nov 06 06:13:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZnYEKWTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:13:56 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf501c18-81b8-4989-9007-6bde87d64e02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:13:56 user nova-compute[74903]: No targets found.
Nov 06 06:13:56 user nova-compute[74903]: iSNS:
Nov 06 06:13:56 user nova-compute[74903]: No targets found.
Nov 06 06:13:56 user nova-compute[74903]: STATIC:
Nov 06 06:13:56 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:13:56 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:13:56 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:13:56 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:13:56 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:13:56 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:13:56 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892
Nov 06 06:13:56 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:13:56 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:13:56 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222
Nov 06 06:13:56 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:13:56 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:13:56 user nova-compute[74903]: FIRMWARE:
Nov 06 06:13:56 user nova-compute[74903]: No targets found.
Nov 06 06:13:56 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:13:56 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:13:56 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a84c327-cc56-4b72-931b-0d2d98e4616f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8614db-7555-4c02-bc0d-4320d2d739d5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:56 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:13:56 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:13:56 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa0860a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222'): ({'sdj'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Removing single pathed devices sdj {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981947c-4219-4b7b-9886-61babc14d139]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb8095-1ad1-4458-9718-49b31ff26b20]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flushing IO for device /dev/sdj {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[76248ca0-a515-4161-ab3a-06e5f920e08d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e8c4e-edae-4da8-9997-2fd3f2a0c968]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] SCSI volumes sdj have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23662653439326636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_67fbcf24', '/dev/disk/by-id/scsi-1SCST_BIO67fbcf24-6be492f6169b7e8b') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330e6a7-8036-4060-875a-628857f982e3]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:13:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[664e8df5-6c11-4a48-ad74-7c5b1e23662f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b9901-e2e6-49e3-aa91-8a70d31837d8]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260]
Nov 06 06:13:57 user nova-compute[74903]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222, portal: 172.16.0.220,3260] successful.
Nov 06 06:13:57 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccbf57d7-2345-4449-b851-8eaac2bff222 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb872a0-6121-4dc2-8b3a-8c69d047827b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== disconnect_volume: return (356ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:13:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Deleting instance files /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1_del
Nov 06 06:13:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Deletion of /opt/stack/data/nova/instances/f07c272e-7eb5-485a-8ad7-c15b9a1be2c1_del complete
Nov 06 06:13:57 user nova-compute[74903]: INFO nova.compute.manager [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 06 06:13:57 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:13:57 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:13:57 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Took 0.55 seconds to deallocate network for instance.
Nov 06 06:13:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:13:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] Acquiring lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:13:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:13:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:13:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] No waiting events found dispatching network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:13:58 user nova-compute[74903]: WARNING nova.compute.manager [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received unexpected event network-vif-plugged-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 for instance with vm_state active and task_state deleting.
Nov 06 06:13:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-57fa3014-0659-49c9-9669-a4dc5cce9af8 req-43d90579-01cb-48e6-b3f4-1db6bdfe18b1 service nova] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Received event network-vif-deleted-ae056fd7-a484-4ed4-b25f-8671ed4df9b6 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:00 user nova-compute[74903]: INFO nova.compute.manager [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Terminating instance
Nov 06 06:14:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-bc291e2e-4fef-4adc-b949-23b8330ab097 req-da5ef7ea-5be7-4263-bd12-b4f0bade908d service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-unplugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Instance destroyed successfully.
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'resources' on Instance uuid c907ba0f-9dd8-494a-846d-13758db2fabc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-217797069',display_name='tempest-ServerActionsTestOtherA-server-217797069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-217797069',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:09:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-augnbf4h',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:11:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=c907ba0f-9dd8-494a-846d-13758db2fabc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2e2b2970-2165-4e87-96f6-8e11994ff516", "address": "fa:16:3e:b2:47:78", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2b2970-21", "ovs_interfaceid": "2e2b2970-2165-4e87-96f6-8e11994ff516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_vif [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2b2970-21, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf734fc3-47ae-4e2a-9606-bb9a07bf0a7b) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:01 user nova-compute[74903]: INFO os_vif [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:47:78,bridge_name='br-int',has_traffic_filtering=True,id=2e2b2970-2165-4e87-96f6-8e11994ff516,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2b2970-21')
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEOcPlox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:14:01 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa8c82-5c3f-43f1-ba66-7f19f6786166]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:14:01 user nova-compute[74903]: No targets found.
Nov 06 06:14:01 user nova-compute[74903]: iSNS:
Nov 06 06:14:01 user nova-compute[74903]: No targets found.
Nov 06 06:14:01 user nova-compute[74903]: STATIC:
Nov 06 06:14:01 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b
Nov 06 06:14:01 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:14:01 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:14:01 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:14:01 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:14:01 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:14:01 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892
Nov 06 06:14:01 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:14:01 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:14:01 user nova-compute[74903]: FIRMWARE:
Nov 06 06:14:01 user nova-compute[74903]: No targets found.
Nov 06 06:14:01 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:14:01 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:14:01 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94558fa-5d75-4f22-9eea-dd23bb0b0705]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fed539-a441-4c79-99e3-11a4b92c896f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:14:01 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:01 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:01 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b (non-flash)
Nov 06 06:14:01 user nova-compute[74903]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:01 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:01 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa286f4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4810dad6-e986-4b7d-99fb-8b50917539f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2b34a-3529-4391-95bb-a5097d991f41]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d80a7-fe8f-463f-bde6-6453d49db677]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f40c73-72a6-499d-a34c-816295e801ab]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b4738a0d', '/dev/disk/by-id/scsi-1SCST_BIOb4738a0d-5a80daf274b96dba', '/dev/disk/by-id/scsi-23561383064616632') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e647fb0-243a-420c-acf5-e5e20aaf13a7]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c869724-8399-4b32-84ed-c205655ecdff]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba30a5-bc76-4f8b-8a8d-c175e2f05b95]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260]
Nov 06 06:14:01 user nova-compute[74903]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b, portal: 172.16.0.220,3260] successful.
Nov 06 06:14:01 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d38b261-0250-4add-be0d-6420f1ad4502]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] <== disconnect_volume: return (330ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:14:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Deleting instance files /opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc_del
Nov 06 06:14:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Deletion of /opt/stack/data/nova/instances/c907ba0f-9dd8-494a-846d-13758db2fabc_del complete
Nov 06 06:14:01 user nova-compute[74903]: INFO nova.compute.manager [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 06 06:14:01 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:14:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:02 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Took 0.82 seconds to deallocate network for instance.
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-399781f1-dd4f-4c7b-bcdf-c790ff81d5c6 req-04fec2b3-083d-4b61-9d02-e8d36e8118b2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-deleted-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:02 user nova-compute[74903]: INFO nova.compute.manager [req-399781f1-dd4f-4c7b-bcdf-c790ff81d5c6 req-04fec2b3-083d-4b61-9d02-e8d36e8118b2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Neutron deleted interface 2e2b2970-2165-4e87-96f6-8e11994ff516; detaching it from the instance and deleting it from the info cache
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.network.neutron [req-399781f1-dd4f-4c7b-bcdf-c790ff81d5c6 req-04fec2b3-083d-4b61-9d02-e8d36e8118b2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-399781f1-dd4f-4c7b-bcdf-c790ff81d5c6 req-04fec2b3-083d-4b61-9d02-e8d36e8118b2 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Detach interface failed, port_id=2e2b2970-2165-4e87-96f6-8e11994ff516, reason: Instance c907ba0f-9dd8-494a-846d-13758db2fabc could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] Acquiring lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] No waiting events found dispatching network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:02 user nova-compute[74903]: WARNING nova.compute.manager [req-2742b650-2bda-499e-befd-4761edbff93d req-2bef6ca9-7e80-4af3-ae78-09c9ee7b7295 service nova] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Received unexpected event network-vif-plugged-2e2b2970-2165-4e87-96f6-8e11994ff516 for instance with vm_state active and task_state deleting.
Nov 06 06:14:03 user nova-compute[74903]: INFO nova.compute.manager [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Took 0.96 seconds to detach 1 volumes for instance.
Nov 06 06:14:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: c907ba0f-9dd8-494a-846d-13758db2fabc] Deleting volume: cb0aae2e-9e60-44e8-8db9-da4a2df4bd5b {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:14:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:03 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:03 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:03 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Deleted allocations for instance c907ba0f-9dd8-494a-846d-13758db2fabc
Nov 06 06:14:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3a5d6834-cf43-430f-8c44-7efd360865e4 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "c907ba0f-9dd8-494a-846d-13758db2fabc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.764s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:09 user nova-compute[74903]: INFO nova.compute.manager [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: f07c272e-7eb5-485a-8ad7-c15b9a1be2c1] Took 11.48 seconds to detach 1 volumes for instance.
Nov 06 06:14:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:09 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:09 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:09 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Deleted allocations for instance f07c272e-7eb5-485a-8ad7-c15b9a1be2c1
Nov 06 06:14:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75683202-31b2-46ec-89ad-cb56e46cfea3 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "f07c272e-7eb5-485a-8ad7-c15b9a1be2c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.757s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:16 user nova-compute[74903]: INFO nova.compute.manager [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Unshelving
Nov 06 06:14:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_requests' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'numa_topology' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:14:16 user nova-compute[74903]: INFO nova.compute.claims [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Claim successful on node user
Nov 06 06:14:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:17 user nova-compute[74903]: INFO nova.network.neutron [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating port dbcf41fa-6220-40e4-9937-dfb775d3d257 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [{"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-42720fc5-a750-4108-bd41-f8834bc4edee" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-changed-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Refreshing instance network info cache due to event network-changed-83e28abd-342f-4933-b5c1-dd8280545312. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] Acquiring lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] Acquired lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Refreshing network info cache for port 83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing instance network info cache due to event network-changed-dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:14:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] Acquiring lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:14:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Creating image(s)
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] Acquired lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Refreshing network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.objects.base [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<b3b4709e-7241-43e6-8300-40efe1b1bb39> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3d16879ac319429107867fcaaa9548557061346" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3d16879ac319429107867fcaaa9548557061346" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updated VIF entry in instance network info cache for port 83e28abd-342f-4933-b5c1-dd8280545312. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updating instance_info_cache with network_info: [{"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f707e70-5b9d-4141-9f53-daa24c283a0c req-f33e25e7-9be5-4baa-a4f0-23257a64acdd service nova] Releasing lock "refresh_cache-eed2efe8-e995-4dd7-bf6d-fd70c7801728" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG nova.virt.images [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4 was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.part /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updated VIF entry in instance network info cache for port dbcf41fa-6220-40e4-9937-dfb775d3d257. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00e1703e-5f5f-4c94-83e6-ee04775de69c req-d7fc41bc-2711-406f-9d84-62f8f495a40c service nova] Releasing lock "refresh_cache-b3b4709e-7241-43e6-8300-40efe1b1bb39" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.part /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.converted" returned: 0 in 0.375s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3d16879ac319429107867fcaaa9548557061346" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.739s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3d16879ac319429107867fcaaa9548557061346" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3d16879ac319429107867fcaaa9548557061346" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346,backing_fmt=raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346,backing_fmt=raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk 1073741824" returned: 0 in 0.058s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3d16879ac319429107867fcaaa9548557061346" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'migration_context' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG nova.objects.base [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<b3b4709e-7241-43e6-8300-40efe1b1bb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:14:21 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Rebasing disk image.
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da -F raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da -F raw /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk" returned: 0 in 2.325s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Ensure instance console log exists: /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start _get_guest_xml network_info=[{"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3c832c8be8fe2b713b84776ff165c629',container_format='bare',created_at=2023-11-06T06:12:24Z,direct_url=<?>,disk_format='qcow2',id=c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-68083741-shelved',owner='371e43fd9d594cd6afca5da129747603',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:12:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:24 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:24 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3c832c8be8fe2b713b84776ff165c629',container_format='bare',created_at=2023-11-06T06:12:24Z,direct_url=<?>,disk_format='qcow2',id=c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-68083741-shelved',owner='371e43fd9d594cd6afca5da129747603',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:12:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.objects.base [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<b3b4709e-7241-43e6-8300-40efe1b1bb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1674601246',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:12:28.857722',shelved_host='user',shelved_image_id='c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'pci_devices' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.objects.base [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Object Instance<b3b4709e-7241-43e6-8300-40efe1b1bb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:14:24 user nova-compute[74903]:   <uuid>b3b4709e-7241-43e6-8300-40efe1b1bb39</uuid>
Nov 06 06:14:24 user nova-compute[74903]:   <name>instance-0000001e</name>
Nov 06 06:14:24 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:14:24 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:14:24 user nova-compute[74903]:   <metadata>
Nov 06 06:14:24 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:14:24 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-68083741</nova:name>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:14:24</nova:creationTime>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:14:24 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:14:24 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:owner>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:user uuid="16796bd87812434689edbdde4d086818">tempest-AttachVolumeShelveTestJSON-1668474455-project-member</nova:user>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:project uuid="371e43fd9d594cd6afca5da129747603">tempest-AttachVolumeShelveTestJSON-1668474455</nova:project>
Nov 06 06:14:24 user nova-compute[74903]:       </nova:owner>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:root type="image" uuid="c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4"/>
Nov 06 06:14:24 user nova-compute[74903]:       <nova:ports>
Nov 06 06:14:24 user nova-compute[74903]:         <nova:port uuid="dbcf41fa-6220-40e4-9937-dfb775d3d257">
Nov 06 06:14:24 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:14:24 user nova-compute[74903]:         </nova:port>
Nov 06 06:14:24 user nova-compute[74903]:       </nova:ports>
Nov 06 06:14:24 user nova-compute[74903]:     </nova:instance>
Nov 06 06:14:24 user nova-compute[74903]:   </metadata>
Nov 06 06:14:24 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:14:24 user nova-compute[74903]:     <system>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="serial">b3b4709e-7241-43e6-8300-40efe1b1bb39</entry>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="uuid">b3b4709e-7241-43e6-8300-40efe1b1bb39</entry>
Nov 06 06:14:24 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:14:24 user nova-compute[74903]:     </system>
Nov 06 06:14:24 user nova-compute[74903]:   </sysinfo>
Nov 06 06:14:24 user nova-compute[74903]:   <os>
Nov 06 06:14:24 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:14:24 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:14:24 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:14:24 user nova-compute[74903]:   </os>
Nov 06 06:14:24 user nova-compute[74903]:   <features>
Nov 06 06:14:24 user nova-compute[74903]:     <acpi/>
Nov 06 06:14:24 user nova-compute[74903]:     <apic/>
Nov 06 06:14:24 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:14:24 user nova-compute[74903]:   </features>
Nov 06 06:14:24 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:14:24 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:14:24 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:14:24 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:14:24 user nova-compute[74903]:   </clock>
Nov 06 06:14:24 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:14:24 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:14:24 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:14:24 user nova-compute[74903]:   </cpu>
Nov 06 06:14:24 user nova-compute[74903]:   <devices>
Nov 06 06:14:24 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:14:24 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:14:24 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk"/>
Nov 06 06:14:24 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:14:24 user nova-compute[74903]:     </disk>
Nov 06 06:14:24 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:14:24 user nova-compute[74903]:       <mac address="fa:16:3e:f7:31:31"/>
Nov 06 06:14:24 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:14:24 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:14:24 user nova-compute[74903]:       <target dev="tapdbcf41fa-62"/>
Nov 06 06:14:24 user nova-compute[74903]:     </interface>
Nov 06 06:14:24 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:14:24 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/console.log" append="off"/>
Nov 06 06:14:24 user nova-compute[74903]:     </serial>
Nov 06 06:14:24 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:14:24 user nova-compute[74903]:     <video>
Nov 06 06:14:24 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:14:24 user nova-compute[74903]:     </video>
Nov 06 06:14:24 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:14:24 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:14:24 user nova-compute[74903]:     </rng>
Nov 06 06:14:24 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:14:24 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:14:24 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:14:24 user nova-compute[74903]:     </memballoon>
Nov 06 06:14:24 user nova-compute[74903]:   </devices>
Nov 06 06:14:24 user nova-compute[74903]: </domain>
Nov 06 06:14:24 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1674601246',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member',shelved_at='2023-11-06T06:12:28.857722',shelved_host='user',shelved_image_id='c7923d16-a1f1-49aa-8bc7-7cfc88e86ba4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG os_vif [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4bd3749-08f4-547b-8d3a-4637db227f56', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbcf41fa-62, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbcf41fa-62, col_values=(('qos', UUID('16d327ca-3f2c-45da-8816-c080eae1ffd9')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbcf41fa-62, col_values=(('external_ids', {'iface-id': 'dbcf41fa-6220-40e4-9937-dfb775d3d257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:31:31', 'vm-uuid': 'b3b4709e-7241-43e6-8300-40efe1b1bb39'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:24 user nova-compute[74903]: INFO os_vif [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62')
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:14:24 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] No VIF found with MAC fa:16:3e:f7:31:31, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lazy-loading 'flavor' on Instance uuid eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:25 user nova-compute[74903]: INFO nova.compute.manager [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Attaching volume ccd11dc9-84c4-4586-bec8-76a0097bd31f to /dev/vdb
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.utils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e80d875-070e-4e4e-90c9-fe68ce5badbb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed4f9b-2308-46de-9398-76f266a3a2cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4a77e-b943-494d-bb3a-08a84207f9ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e64f3e-2575-4d5a-b29b-aae48356d54c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:14:25 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:14:25 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f727adf3-49d2-4c4b-bd4b-884f734fa8f1]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG os_brick.utils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updating existing volume attachment record: 5090ff27-8809-4aa8-8605-9c9a7a76e38c {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:26 user nova-compute[74903]: WARNING nova.compute.manager [req-ae4ebc02-b524-4ff4-b377-b1e00a8bac9c req-e2c80d21-e8e9-4f00-8677-4708dd31d871 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:14:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:14:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance spawned successfully.
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:28 user nova-compute[74903]: WARNING nova.compute.manager [req-44df9405-ad59-4fe9-956a-39af3c240846 req-bfb869ea-9c9c-42f4-b109-16a6c23daaa1 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1c27de3b-6c43-4eb3-ab0e-adf33317bf35 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.949s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:14:29 user nova-compute[74903]: INFO nova.compute.claims [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Claim successful on node user
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:14:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.policy [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8673337612a54ca0a89d180a830cbaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ac2801ad3f4b75bc98d85071d479c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:14:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Creating image(s)
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "/opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.230s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.262s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk 1073741824" returned: 0 in 0.061s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Successfully created port: 5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Cannot resize image /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Ensure instance console log exists: /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Successfully updated port: 5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-changed-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Refreshing instance network info cache due to event network-changed-5461551d-7d52-4759-a4ec-3d8942f088a8. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] Acquiring lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] Acquired lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Refreshing network info cache for port 5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:14:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=24.94063949584961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 2725665f-e47b-4f6b-97c8-e74f0f6f4b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 82322fae-3f99-4324-b0b3-3098f01f87fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dae78a78-8bb6-4c1b-84bd-aeb44fd38729 req-7a159e23-2390-4589-9cdc-8dfee8ef25d8 service nova] Releasing lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquired lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Releasing lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance network_info: |[{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Start _get_guest_xml network_info=[{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:14:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54089458',display_name='tempest-AttachVolumeNegativeTest-server-54089458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54089458',id=34,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzMsWPVR5/zqcYkbRVd7CPaAnLNZoXlCTzW9ozcqwd1/dLtFV1LnGexo8v2aYBOjkjqVpNb6QRKPq2/MnGe1mKXz+3hINvSgVwCDCY7FZa54UXoR0/unm2SjIJWRb1xGw==',key_name='tempest-keypair-1573669941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-ihiq96mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=f57a3014-91be-48b7-8aa4-f18b3d29c93d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'pci_devices' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:14:32 user nova-compute[74903]:   <uuid>f57a3014-91be-48b7-8aa4-f18b3d29c93d</uuid>
Nov 06 06:14:32 user nova-compute[74903]:   <name>instance-00000022</name>
Nov 06 06:14:32 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:14:32 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:14:32 user nova-compute[74903]:   <metadata>
Nov 06 06:14:32 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:14:32 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeNegativeTest-server-54089458</nova:name>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:14:32</nova:creationTime>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:14:32 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:14:32 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:owner>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:user uuid="8673337612a54ca0a89d180a830cbaf5">tempest-AttachVolumeNegativeTest-1944196622-project-member</nova:user>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:project uuid="b9ac2801ad3f4b75bc98d85071d479c6">tempest-AttachVolumeNegativeTest-1944196622</nova:project>
Nov 06 06:14:32 user nova-compute[74903]:       </nova:owner>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:14:32 user nova-compute[74903]:       <nova:ports>
Nov 06 06:14:32 user nova-compute[74903]:         <nova:port uuid="5461551d-7d52-4759-a4ec-3d8942f088a8">
Nov 06 06:14:32 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 06:14:32 user nova-compute[74903]:         </nova:port>
Nov 06 06:14:32 user nova-compute[74903]:       </nova:ports>
Nov 06 06:14:32 user nova-compute[74903]:     </nova:instance>
Nov 06 06:14:32 user nova-compute[74903]:   </metadata>
Nov 06 06:14:32 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:14:32 user nova-compute[74903]:     <system>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="serial">f57a3014-91be-48b7-8aa4-f18b3d29c93d</entry>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="uuid">f57a3014-91be-48b7-8aa4-f18b3d29c93d</entry>
Nov 06 06:14:32 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:14:32 user nova-compute[74903]:     </system>
Nov 06 06:14:32 user nova-compute[74903]:   </sysinfo>
Nov 06 06:14:32 user nova-compute[74903]:   <os>
Nov 06 06:14:32 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:14:32 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:14:32 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:14:32 user nova-compute[74903]:   </os>
Nov 06 06:14:32 user nova-compute[74903]:   <features>
Nov 06 06:14:32 user nova-compute[74903]:     <acpi/>
Nov 06 06:14:32 user nova-compute[74903]:     <apic/>
Nov 06 06:14:32 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:14:32 user nova-compute[74903]:   </features>
Nov 06 06:14:32 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:14:32 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:14:32 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:14:32 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:14:32 user nova-compute[74903]:   </clock>
Nov 06 06:14:32 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:14:32 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:14:32 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:14:32 user nova-compute[74903]:   </cpu>
Nov 06 06:14:32 user nova-compute[74903]:   <devices>
Nov 06 06:14:32 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:14:32 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:14:32 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk"/>
Nov 06 06:14:32 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:14:32 user nova-compute[74903]:     </disk>
Nov 06 06:14:32 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:14:32 user nova-compute[74903]:       <mac address="fa:16:3e:7b:3a:14"/>
Nov 06 06:14:32 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:14:32 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:14:32 user nova-compute[74903]:       <target dev="tap5461551d-7d"/>
Nov 06 06:14:32 user nova-compute[74903]:     </interface>
Nov 06 06:14:32 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:14:32 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/console.log" append="off"/>
Nov 06 06:14:32 user nova-compute[74903]:     </serial>
Nov 06 06:14:32 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:14:32 user nova-compute[74903]:     <video>
Nov 06 06:14:32 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:14:32 user nova-compute[74903]:     </video>
Nov 06 06:14:32 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:14:32 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:14:32 user nova-compute[74903]:     </rng>
Nov 06 06:14:32 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:14:32 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:14:32 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:14:32 user nova-compute[74903]:     </memballoon>
Nov 06 06:14:32 user nova-compute[74903]:   </devices>
Nov 06 06:14:32 user nova-compute[74903]: </domain>
Nov 06 06:14:32 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54089458',display_name='tempest-AttachVolumeNegativeTest-server-54089458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54089458',id=34,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzMsWPVR5/zqcYkbRVd7CPaAnLNZoXlCTzW9ozcqwd1/dLtFV1LnGexo8v2aYBOjkjqVpNb6QRKPq2/MnGe1mKXz+3hINvSgVwCDCY7FZa54UXoR0/unm2SjIJWRb1xGw==',key_name='tempest-keypair-1573669941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-ihiq96mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=f57a3014-91be-48b7-8aa4-f18b3d29c93d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG os_vif [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a01b7e33-b0f8-5669-b421-80ca339e804c', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5461551d-7d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5461551d-7d, col_values=(('qos', UUID('f5f5e1d8-5c57-45de-982c-13845e347e7d')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5461551d-7d, col_values=(('external_ids', {'iface-id': '5461551d-7d52-4759-a4ec-3d8942f088a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3a:14', 'vm-uuid': 'f57a3014-91be-48b7-8aa4-f18b3d29c93d'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:32 user nova-compute[74903]: INFO os_vif [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d')
Nov 06 06:14:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:14:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:7b:3a:14, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:14:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] No waiting events found dispatching network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:34 user nova-compute[74903]: WARNING nova.compute.manager [req-5c0dd4ed-7747-40a1-9bff-66fd2f61b7bd req-395bfe29-07e9-46ec-b79d-e5a54a1c5a5b service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received unexpected event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 for instance with vm_state building and task_state spawning.
Nov 06 06:14:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] No waiting events found dispatching network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:36 user nova-compute[74903]: WARNING nova.compute.manager [req-1b7867e2-74a6-49bb-9998-5defc0f54f76 req-07c4ecd2-8dd5-40d5-b10a-dd791280c687 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received unexpected event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 for instance with vm_state building and task_state spawning.
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:14:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance spawned successfully.
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:14:37 user nova-compute[74903]: INFO nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 06 06:14:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:14:37 user nova-compute[74903]: INFO nova.compute.manager [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Took 8.18 seconds to build instance.
Nov 06 06:14:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e19d1a3-a81c-450f-8c72-594bdfa62137 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.389s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:46 user nova-compute[74903]: INFO nova.compute.manager [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Terminating instance
Nov 06 06:14:46 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Instance destroyed successfully.
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-60015138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-60015138',id=24,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:04:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-5zz82357',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:06:31Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=5b6b2cf0-a775-4119-a892-425c4e3a2cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "eb3c49d0-5a46-446b-b594-6446e184d613", "address": "fa:16:3e:76:d9:5f", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb3c49d0-5a", "ovs_interfaceid": "eb3c49d0-5a46-446b-b594-6446e184d613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG os_vif [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb3c49d0-5a, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=511db34d-6572-4bcb-a860-c9fa740113de) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:14:47 user nova-compute[74903]: INFO os_vif [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:d9:5f,bridge_name='br-int',has_traffic_filtering=True,id=eb3c49d0-5a46-446b-b594-6446e184d613,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb3c49d0-5a')
Nov 06 06:14:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Deleting instance files /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9_del
Nov 06 06:14:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Deletion of /opt/stack/data/nova/instances/5b6b2cf0-a775-4119-a892-425c4e3a2cb9_del complete
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-unplugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] No waiting events found dispatching network-vif-unplugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-48e7b23c-3760-4077-8e18-582484f7753c req-282e29ea-0a3c-4131-822b-1e22e88f43b6 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-unplugged-eb3c49d0-5a46-446b-b594-6446e184d613 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:14:47 user nova-compute[74903]: INFO nova.compute.manager [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 06 06:14:47 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:14:47 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:48 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Took 0.52 seconds to deallocate network for instance.
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-885a7cf1-8366-4af9-937a-40f59a26d0a3 req-3cd08eba-cf83-410d-aeab-b6194c0791f9 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-deleted-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:48 user nova-compute[74903]: INFO nova.compute.manager [req-885a7cf1-8366-4af9-937a-40f59a26d0a3 req-3cd08eba-cf83-410d-aeab-b6194c0791f9 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Neutron deleted interface eb3c49d0-5a46-446b-b594-6446e184d613; detaching it from the instance and deleting it from the info cache
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-885a7cf1-8366-4af9-937a-40f59a26d0a3 req-3cd08eba-cf83-410d-aeab-b6194c0791f9 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-885a7cf1-8366-4af9-937a-40f59a26d0a3 req-3cd08eba-cf83-410d-aeab-b6194c0791f9 service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Detach interface failed, port_id=eb3c49d0-5a46-446b-b594-6446e184d613, reason: Instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:14:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:48 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Deleted allocations for instance 5b6b2cf0-a775-4119-a892-425c4e3a2cb9
Nov 06 06:14:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f208699c-5fe9-41bb-9652-5ecff4a558e1 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:14:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] Acquiring lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] Lock "5b6b2cf0-a775-4119-a892-425c4e3a2cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] No waiting events found dispatching network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:14:49 user nova-compute[74903]: WARNING nova.compute.manager [req-9b96d227-5ca4-40ea-988e-6357ccff61a0 req-95af5539-9234-4d95-8a86-85fa732e541e service nova] [instance: 5b6b2cf0-a775-4119-a892-425c4e3a2cb9] Received unexpected event network-vif-plugged-eb3c49d0-5a46-446b-b594-6446e184d613 for instance with vm_state deleted and task_state None.
Nov 06 06:14:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSWeFavn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:14:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:14:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:14:51 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a799533d-8782-4754-84da-a943d514766f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:14:51 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2e827-6ca0-4226-8f6c-f35cb8e132cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f] added
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6652c5-3a11-4504-a38e-8a7988be3c69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b561f-45aa-4b37-8a02-d75ab09f4d4d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSWeFavn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSWeFavn" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[066ab646-cb2a-457f-b604-c0864ec074be]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSWeFavn'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ae3bc-10db-4423-95c0-4d474f1f7547]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[62968c2a-7a05-4b6b-914a-b64ea7ff2001]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae3e97-e029-400f-830c-47898e9de248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260]
Nov 06 06:14:51 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260] successful.
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d4f03-0700-4860-b09d-342b8a1c47a9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a29d95-cb64-4d08-b83f-ec45b1afcac7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:14:51 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:14:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778c507-3741-4e55-8402-4bd63907e39f]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSWeFavn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:14:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23962303964393531', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962303964393531', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lazy-loading 'flavor' on Instance uuid eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:14:52 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:14:52 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:14:52 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:14:52 user nova-compute[74903]:   <serial>ccd11dc9-84c4-4586-bec8-76a0097bd31f</serial>
Nov 06 06:14:52 user nova-compute[74903]: </disk>
Nov 06 06:14:52 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:14:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] No VIF found with MAC fa:16:3e:45:f7:b1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:14:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7620a5af-bc47-42dd-9424-bd62d8106ca3 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.777s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:14:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:14:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:14:55 user nova-compute[74903]: INFO nova.compute.manager [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Detaching volume ccd11dc9-84c4-4586-bec8-76a0097bd31f
Nov 06 06:14:55 user nova-compute[74903]: INFO nova.virt.block_device [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Attempting to driver detach volume ccd11dc9-84c4-4586-bec8-76a0097bd31f from mountpoint /dev/vdb
Nov 06 06:14:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Attempting to detach device vdb from instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:14:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:14:55 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:14:55 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:14:55 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:14:55 user nova-compute[74903]:   <serial>ccd11dc9-84c4-4586-bec8-76a0097bd31f</serial>
Nov 06 06:14:55 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:14:55 user nova-compute[74903]: </disk>
Nov 06 06:14:55 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:14:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Successfully detached device vdb from instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 from the persistent domain config.
Nov 06 06:14:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:14:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:14:55 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:14:55 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:14:55 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:14:55 user nova-compute[74903]:   <serial>ccd11dc9-84c4-4586-bec8-76a0097bd31f</serial>
Nov 06 06:14:55 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:14:55 user nova-compute[74903]: </disk>
Nov 06 06:14:55 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:14:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:14:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:14:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:02 user nova-compute[74903]: INFO nova.compute.manager [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Terminating instance
Nov 06 06:15:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-unplugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] No waiting events found dispatching network-vif-unplugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-b7447848-3a7f-447f-beda-e73cc24385bf req-6a3b151e-2de6-4ff9-9154-28423b7cedf8 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-unplugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:15:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Instance destroyed successfully.
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lazy-loading 'resources' on Instance uuid 00426b5a-c105-48da-ab5f-82f04a4dd090 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-722628018',display_name='tempest-ServerActionsTestOtherA-server-722628018',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-722628018',id=6,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7RerblxXRKKJODhK0/ft1r7ZwJnls+2XhavZfPAR4xukQxPp9gOy6OPNWpM9H8C4iDOYt+3Z/T/7Wrg9Nj/EUyU7xttsjzUhaMioABzX1FasVOEVJ5HstqPenufjUHNw==',key_name='tempest-keypair-2102767960',keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29b574412f0d4156a9d4538b17b2c163',ramdisk_id='',reservation_id='r-61wuii0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-851074598',owner_user_name='tempest-ServerActionsTestOtherA-851074598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:55:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44c3df905516436e8a6c39e0f32a2e4b',uuid=00426b5a-c105-48da-ab5f-82f04a4dd090,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converting VIF {"id": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "address": "fa:16:3e:50:16:c5", "network": {"id": "1fca968f-56f6-441b-8c0f-43847f766d29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-581362795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29b574412f0d4156a9d4538b17b2c163", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dbd1bff-f4", "ovs_interfaceid": "2dbd1bff-f466-401e-919d-ef5a28920fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG os_vif [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dbd1bff-f4, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eae42f9d-187f-4eef-927d-6a60a8dcac90) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:03 user nova-compute[74903]: INFO os_vif [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:16:c5,bridge_name='br-int',has_traffic_filtering=True,id=2dbd1bff-f466-401e-919d-ef5a28920fe3,network=Network(1fca968f-56f6-441b-8c0f-43847f766d29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dbd1bff-f4')
Nov 06 06:15:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Deleting instance files /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090_del
Nov 06 06:15:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Deletion of /opt/stack/data/nova/instances/00426b5a-c105-48da-ab5f-82f04a4dd090_del complete
Nov 06 06:15:03 user nova-compute[74903]: INFO nova.compute.manager [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 06:15:03 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:15:03 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:04 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Took 0.43 seconds to deallocate network for instance.
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0e70eb9-88b5-4f22-bce0-990d9f11040c req-ebf19273-d85c-42b0-ab80-9af1c19126df service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-deleted-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:04 user nova-compute[74903]: INFO nova.compute.manager [req-b0e70eb9-88b5-4f22-bce0-990d9f11040c req-ebf19273-d85c-42b0-ab80-9af1c19126df service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Neutron deleted interface 2dbd1bff-f466-401e-919d-ef5a28920fe3; detaching it from the instance and deleting it from the info cache
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-b0e70eb9-88b5-4f22-bce0-990d9f11040c req-ebf19273-d85c-42b0-ab80-9af1c19126df service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0e70eb9-88b5-4f22-bce0-990d9f11040c req-ebf19273-d85c-42b0-ab80-9af1c19126df service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Detach interface failed, port_id=2dbd1bff-f466-401e-919d-ef5a28920fe3, reason: Instance 00426b5a-c105-48da-ab5f-82f04a4dd090 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:15:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:04 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Deleted allocations for instance 00426b5a-c105-48da-ab5f-82f04a4dd090
Nov 06 06:15:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-e42a5381-5267-48e1-8dde-0b68e2d25b87 tempest-ServerActionsTestOtherA-851074598 tempest-ServerActionsTestOtherA-851074598-project-member] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] Acquiring lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] Lock "00426b5a-c105-48da-ab5f-82f04a4dd090-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] No waiting events found dispatching network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:05 user nova-compute[74903]: WARNING nova.compute.manager [req-40a27ff5-7bf4-4b7c-bc01-299f614a8350 req-156cf1dc-06d7-4834-83e3-5f8c623a4c58 service nova] [instance: 00426b5a-c105-48da-ab5f-82f04a4dd090] Received unexpected event network-vif-plugged-2dbd1bff-f466-401e-919d-ef5a28920fe3 for instance with vm_state deleted and task_state None.
Nov 06 06:15:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:07 user nova-compute[74903]: INFO nova.compute.manager [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Terminating instance
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-changed-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Refreshing instance network info cache due to event network-changed-dc00fca4-8c23-4173-a597-8781b02a66b9. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] Acquiring lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] Acquired lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Refreshing network info cache for port dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: INFO nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Rebuilding instance
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-unplugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] No waiting events found dispatching network-vif-unplugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-05d517fd-f712-4242-95be-e6ee35708839 req-a965e042-eb56-46ae-976f-c442d5993bb7 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-unplugged-42721555-cfdc-4549-89d7-b6f2ec834286 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Instance destroyed successfully.
Nov 06 06:15:07 user nova-compute[74903]: DEBUG nova.objects.instance [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'resources' on Instance uuid 2725665f-e47b-4f6b-97c8-e74f0f6f4b31 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:15:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396562724',display_name='tempest-VolumesAdminNegativeTest-server-1396562724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396562724',id=32,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:12:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-754b40lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:12:48Z,user_data=None,user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=2725665f-e47b-4f6b-97c8-e74f0f6f4b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "42721555-cfdc-4549-89d7-b6f2ec834286", "address": "fa:16:3e:b4:76:42", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42721555-cf", "ovs_interfaceid": "42721555-cfdc-4549-89d7-b6f2ec834286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_vif [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42721555-cf, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cce1bdc-b3af-48ad-8a08-7be453593d2e) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: INFO os_vif [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:76:42,bridge_name='br-int',has_traffic_filtering=True,id=42721555-cfdc-4549-89d7-b6f2ec834286,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42721555-cf')
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Deleting instance files /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31_del
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Deletion of /opt/stack/data/nova/instances/2725665f-e47b-4f6b-97c8-e74f0f6f4b31_del complete
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updated VIF entry in instance network info cache for port dc00fca4-8c23-4173-a597-8781b02a66b9. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating instance_info_cache with network_info: [{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.compute.manager [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ae3585-5476-4ba0-ad0a-a400d062335e req-500adba2-51db-4cc5-b9f3-bcdbd655e782 service nova] Releasing lock "refresh_cache-82322fae-3f99-4324-b0b3-3098f01f87fa" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance destroyed successfully.
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance destroyed successfully.
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1131133262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc00fca4-8c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e722e5df-b448-44f1-8446-a0b0097bc18f) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:08 user nova-compute[74903]: INFO os_vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c')
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:15:08 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b453ccbb-542d-4d35-bc6c-92e323161776]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:15:08 user nova-compute[74903]: No targets found.
Nov 06 06:15:08 user nova-compute[74903]: iSNS:
Nov 06 06:15:08 user nova-compute[74903]: No targets found.
Nov 06 06:15:08 user nova-compute[74903]: STATIC:
Nov 06 06:15:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f
Nov 06 06:15:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:15:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:08 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892
Nov 06 06:15:08 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:08 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:08 user nova-compute[74903]: FIRMWARE:
Nov 06 06:15:08 user nova-compute[74903]: No targets found.
Nov 06 06:15:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:15:08 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:15:08 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8391cfcb-905c-4037-8031-ed51633b5b2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2206ab9-ab1c-459e-b659-b92b9967471b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:15:08 user nova-compute[74903]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:15:08 user nova-compute[74903]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:08 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085b6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c0f698-63d9-4ce7-9de0-ce943579cb3a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e283102-6114-4119-8cbe-cf2aacb86983]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdc2692-191c-4b77-ac5b-1d626eabb272]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.089s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e6961-a2d7-43ff-9988-188dfcba8c01]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd930b24a-bdf2b2623a609f9d', '/dev/disk/by-id/scsi-26264663262323632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d930b24a') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0185e-da8d-4f16-b1da-93f9889bac82]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca115014-e676-42f2-8765-85d9dd18d15d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9adde61-d0bb-4c34-a73d-f6b7b4725e84]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]
Nov 06 06:15:08 user nova-compute[74903]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.
Nov 06 06:15:08 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5790ea9-a758-4359-a38a-b115ac973c90]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== disconnect_volume: return (420ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:15:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deleting instance files /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa_del
Nov 06 06:15:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deletion of /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa_del complete
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:09 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Took 0.85 seconds to deallocate network for instance.
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:09 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 82322fae-3f99-4324-b0b3-3098f01f87fa could not be found.
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:15:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[01410f03-fe7c-4dd2-83b9-e9019fc7c07f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:15:09 user nova-compute[74903]: No targets found.
Nov 06 06:15:09 user nova-compute[74903]: iSNS:
Nov 06 06:15:09 user nova-compute[74903]: No targets found.
Nov 06 06:15:09 user nova-compute[74903]: STATIC:
Nov 06 06:15:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f
Nov 06 06:15:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:15:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:09 user nova-compute[74903]: FIRMWARE:
Nov 06 06:15:09 user nova-compute[74903]: No targets found.
Nov 06 06:15:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:15:09 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:15:09 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9daba3-3ec4-422f-9286-353a180922df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e182e2-0949-4058-9200-22ee689e5b9f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:09 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa0859bc70>, {}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Disconnecting from: [] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== disconnect_volume: return (78ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:09 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Deleted allocations for instance 2725665f-e47b-4f6b-97c8-e74f0f6f4b31
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-07c1c2b4-4b80-4bba-a779-3be3580e4b83 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Acquiring lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "2725665f-e47b-4f6b-97c8-e74f0f6f4b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] No waiting events found dispatching network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:09 user nova-compute[74903]: WARNING nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received unexpected event network-vif-plugged-42721555-cfdc-4549-89d7-b6f2ec834286 for instance with vm_state deleted and task_state None.
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:09 user nova-compute[74903]: WARNING nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state active and task_state rebuilding.
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:09 user nova-compute[74903]: WARNING nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state active and task_state rebuilding.
Nov 06 06:15:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-63642ec6-3214-4da5-9853-bfe821d83ce1 req-3488d7fe-176b-4f7a-9fd8-d2f8ccf81e38 service nova] [instance: 2725665f-e47b-4f6b-97c8-e74f0f6f4b31] Received event network-vif-deleted-42721555-cfdc-4549-89d7-b6f2ec834286 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:15 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 is timed out.
Nov 06 06:15:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Successfully detached device vdb from instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 from the live domain config.
Nov 06 06:15:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSWeFavn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:15:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59e9196-7d11-429e-9568-f96f760b9c68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:15:15 user nova-compute[74903]: No targets found.
Nov 06 06:15:15 user nova-compute[74903]: iSNS:
Nov 06 06:15:15 user nova-compute[74903]: No targets found.
Nov 06 06:15:15 user nova-compute[74903]: STATIC:
Nov 06 06:15:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f
Nov 06 06:15:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:15:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:15 user nova-compute[74903]: FIRMWARE:
Nov 06 06:15:15 user nova-compute[74903]: No targets found.
Nov 06 06:15:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:15:15 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:15:15 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ff228a-4247-45b3-b998-550a107a9ed8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[07490e4b-08db-4567-9ed3-e06dcc9f5350]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:15 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f (non-flash)
Nov 06 06:15:15 user nova-compute[74903]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08616c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53de39-b1ec-4328-824d-e8aad2f6d29a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5072ff8-0643-4dd5-ba7c-4584a1bdb1ad]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afb9304-0711-4d75-bf95-fff7653dc01b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c35c01-9ef9-4700-ae86-1c31bacc9953]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79247f1a-3212-498b-b196-f740e055d15b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[44208451-e4c6-493f-9890-35dd46818ecd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260]
Nov 06 06:15:15 user nova-compute[74903]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f, portal: 172.16.0.220,3260] successful.
Nov 06 06:15:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccd11dc9-84c4-4586-bec8-76a0097bd31f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856726e-189e-443d-b6dd-ce69feead9e6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] <== disconnect_volume: return (318ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:15:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:15:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lazy-loading 'flavor' on Instance uuid eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:15:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c369d307-83f9-4681-acd0-5fa7283f0141 tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.960s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Preparing to wait for external event volume-reimaged-f5099a81-297c-4ddd-afbc-3767e9f86892 {{(pid=74903) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [{"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-33a299c1-0d52-464c-8ca9-b3fd49f43ef7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:15:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:15:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:15:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:15:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:15:30 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8156MB free_disk=25.18655776977539GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 42720fc5-a750-4108-bd41-f8834bc4edee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance eed2efe8-e995-4dd7-bf6d-fd70c7801728 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 82322fae-3f99-4324-b0b3-3098f01f87fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:15:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:15:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:37 user nova-compute[74903]: INFO nova.compute.manager [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Terminating instance
Nov 06 06:15:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-6214fca5-520c-4c67-a31c-79b7f10ce04e req-4f322231-0c5b-419f-b1e2-aabf4a73c38f service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Instance destroyed successfully.
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.objects.instance [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid 42720fc5-a750-4108-bd41-f8834bc4edee {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:58:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1622863304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1622863304',id=13,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-rrug10ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:02:47Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=42720fc5-a750-4108-bd41-f8834bc4edee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "address": "fa:16:3e:6e:f6:48", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad661255-20", "ovs_interfaceid": "ad661255-20e8-4a90-a42f-3a7d37b4c04d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_vif [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad661255-20, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bacbfac-91bb-461e-9080-28c50523f71f) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:38 user nova-compute[74903]: INFO os_vif [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:f6:48,bridge_name='br-int',has_traffic_filtering=True,id=ad661255-20e8-4a90-a42f-3a7d37b4c04d,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad661255-20')
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEiDpIQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:15:38 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4120b478-30aa-48cc-874d-a13c51ce7138]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:15:38 user nova-compute[74903]: No targets found.
Nov 06 06:15:38 user nova-compute[74903]: iSNS:
Nov 06 06:15:38 user nova-compute[74903]: No targets found.
Nov 06 06:15:38 user nova-compute[74903]: STATIC:
Nov 06 06:15:38 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a
Nov 06 06:15:38 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:15:38 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:15:38 user nova-compute[74903]: FIRMWARE:
Nov 06 06:15:38 user nova-compute[74903]: No targets found.
Nov 06 06:15:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:15:38 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:15:38 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2b2b2-13ed-444e-a270-54c39b22a531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6aaf7f-eca6-4ff0-b1fc-7ccdf13fb1ee]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a (non-flash)
Nov 06 06:15:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4028c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c3a25-bac5-43b6-9758-4ed91c191eef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6855e2-88ec-4890-b144-c7a4d7e4231c]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5bd93c-74ef-4950-b71c-dae63178ac41]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dce76a-ccc4-4c05-a016-a4dc2215b6a9]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783074d-4a1f-4e2c-b24e-899bef6eedb7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d30920e-a1f6-4761-83a6-0331aec5323a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260]
Nov 06 06:15:38 user nova-compute[74903]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a, portal: 172.16.0.220,3260] successful.
Nov 06 06:15:38 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5af6cb59-d53b-4c7a-a6cc-d1f687e3ea7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5cc8ba-54e2-42ad-ab2d-847d62d48166]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] <== disconnect_volume: return (326ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:15:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Deleting instance files /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee_del
Nov 06 06:15:38 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Deletion of /opt/stack/data/nova/instances/42720fc5-a750-4108-bd41-f8834bc4edee_del complete
Nov 06 06:15:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:38 user nova-compute[74903]: INFO nova.compute.manager [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 06 06:15:38 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:15:38 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:39 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Took 1.01 seconds to deallocate network for instance.
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:39 user nova-compute[74903]: WARNING nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state deleting.
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:39 user nova-compute[74903]: WARNING nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state deleting.
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:39 user nova-compute[74903]: WARNING nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state deleting.
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-unplugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Acquiring lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] Lock "42720fc5-a750-4108-bd41-f8834bc4edee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] No waiting events found dispatching network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:39 user nova-compute[74903]: WARNING nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received unexpected event network-vif-plugged-ad661255-20e8-4a90-a42f-3a7d37b4c04d for instance with vm_state active and task_state deleting.
Nov 06 06:15:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-67f421a6-787a-42f5-9934-94b5896f4188 req-0b4bf08c-f0fc-4795-918f-25da29b55cd4 service nova] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Received event network-vif-deleted-ad661255-20e8-4a90-a42f-3a7d37b4c04d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:40 user nova-compute[74903]: INFO nova.compute.manager [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 42720fc5-a750-4108-bd41-f8834bc4edee] Took 0.93 seconds to detach 1 volumes for instance.
Nov 06 06:15:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:40 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:15:40 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:15:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:41 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Deleted allocations for instance 42720fc5-a750-4108-bd41-f8834bc4edee
Nov 06 06:15:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-778475ef-d4aa-4d4d-b5c1-4638a0177250 tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "42720fc5-a750-4108-bd41-f8834bc4edee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.681s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:15:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:56 user nova-compute[74903]: INFO nova.compute.manager [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Terminating instance
Nov 06 06:15:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-unplugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] No waiting events found dispatching network-vif-unplugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-7132e17e-f6ba-4a3b-9a43-4cec6f0174e6 req-2ed9e895-ac10-493e-b8ab-1aef7ca0e6f5 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-unplugged-83e28abd-342f-4933-b5c1-dd8280545312 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:15:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Instance destroyed successfully.
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lazy-loading 'resources' on Instance uuid eed2efe8-e995-4dd7-bf6d-fd70c7801728 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1273966092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1273966',id=31,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUZ4qY4i+UEX+RPSMwM5W4KwahGyljIciMHj+0tFU0SzevTl4vAxDr6XzXboVB1GxKAzeDwtWcNzCUUUAR4guwFyDNfrKKShCcKes1lBzz7iK0rcq0jBwYVgaYdzqHQMg==',key_name='tempest-keypair-666108101',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:12:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8edf9bd5d4024967a74ab3c6c90fb965',ramdisk_id='',reservation_id='r-gff4ub0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73771ca807e0483caa58fcd0a84b95ff',uuid=eed2efe8-e995-4dd7-bf6d-fd70c7801728,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converting VIF {"id": "83e28abd-342f-4933-b5c1-dd8280545312", "address": "fa:16:3e:45:f7:b1", "network": {"id": "9503bbd2-7231-4c1a-a37f-0a2de6c39dd2", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1252465430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8edf9bd5d4024967a74ab3c6c90fb965", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83e28abd-34", "ovs_interfaceid": "83e28abd-342f-4933-b5c1-dd8280545312", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG os_vif [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83e28abd-34, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01593cb3-dc6c-47d9-8981-68e504d3b09d) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:15:57 user nova-compute[74903]: INFO os_vif [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=83e28abd-342f-4933-b5c1-dd8280545312,network=Network(9503bbd2-7231-4c1a-a37f-0a2de6c39dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83e28abd-34')
Nov 06 06:15:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Deleting instance files /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728_del
Nov 06 06:15:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Deletion of /opt/stack/data/nova/instances/eed2efe8-e995-4dd7-bf6d-fd70c7801728_del complete
Nov 06 06:15:57 user nova-compute[74903]: INFO nova.compute.manager [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 06:15:57 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:15:57 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:15:58 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Took 0.85 seconds to deallocate network for instance.
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-9ac71ab7-7d6d-4c70-919d-adf9166438ba req-50b48a9f-c464-4808-b5e2-d9463d9b5010 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-deleted-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:58 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Deleted allocations for instance eed2efe8-e995-4dd7-bf6d-fd70c7801728
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3aca7d5f-6d10-4d4a-8f27-0d13cb8178dd tempest-TestServerVolumeAttachScenarioOldVersion-84580362 tempest-TestServerVolumeAttachScenarioOldVersion-84580362-project-member] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] Acquiring lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] Lock "eed2efe8-e995-4dd7-bf6d-fd70c7801728-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:15:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] No waiting events found dispatching network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:15:58 user nova-compute[74903]: WARNING nova.compute.manager [req-51e823b2-caf7-4821-bae0-f599b52640cb req-d63a76a9-8839-47e4-b825-d7a494166256 service nova] [instance: eed2efe8-e995-4dd7-bf6d-fd70c7801728] Received unexpected event network-vif-plugged-83e28abd-342f-4933-b5c1-dd8280545312 for instance with vm_state deleted and task_state None.
Nov 06 06:16:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:06 user nova-compute[74903]: INFO nova.compute.manager [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Terminating instance
Nov 06 06:16:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1a67c8e6-8428-4615-846c-9e356be7224a req-c78a734e-d482-46d4-9f05-c4426178ec9c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-unplugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:16:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Instance destroyed successfully.
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.objects.instance [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lazy-loading 'resources' on Instance uuid b3b4709e-7241-43e6-8300-40efe1b1bb39 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-68083741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-68083741',id=30,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDh6eJHL+FCKM86OoBb7Xbywn1oDRpdylkpGOm1nqTP1B/yd47syZxBxGPkrGNvmZd92voswPNizY7CrUqhmHLu5LCn/KTyRb8jtA/s8+kQ8gLGqXENGf+QQdGtwdA6MFw==',key_name='tempest-keypair-1674601246',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='371e43fd9d594cd6afca5da129747603',ramdisk_id='',reservation_id='r-uj5cxetl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1668474455',owner_user_name='tempest-AttachVolumeShelveTestJSON-1668474455-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:14:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16796bd87812434689edbdde4d086818',uuid=b3b4709e-7241-43e6-8300-40efe1b1bb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converting VIF {"id": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "address": "fa:16:3e:f7:31:31", "network": {"id": "b32596c7-77bc-4bb7-9da6-14a6b0491266", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-290821539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "371e43fd9d594cd6afca5da129747603", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbcf41fa-62", "ovs_interfaceid": "dbcf41fa-6220-40e4-9937-dfb775d3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG os_vif [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbcf41fa-62, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16d327ca-3f2c-45da-8816-c080eae1ffd9) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:07 user nova-compute[74903]: INFO os_vif [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:31:31,bridge_name='br-int',has_traffic_filtering=True,id=dbcf41fa-6220-40e4-9937-dfb775d3d257,network=Network(b32596c7-77bc-4bb7-9da6-14a6b0491266),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbcf41fa-62')
Nov 06 06:16:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Deleting instance files /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39_del
Nov 06 06:16:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Deletion of /opt/stack/data/nova/instances/b3b4709e-7241-43e6-8300-40efe1b1bb39_del complete
Nov 06 06:16:07 user nova-compute[74903]: INFO nova.compute.manager [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 06:16:07 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:16:07 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-3d56995f-b6c9-4899-a9f2-5d9dee6d9504 req-8c0dcdf1-d151-41b9-9f6e-389bee952cf9 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-deleted-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:08 user nova-compute[74903]: INFO nova.compute.manager [req-3d56995f-b6c9-4899-a9f2-5d9dee6d9504 req-8c0dcdf1-d151-41b9-9f6e-389bee952cf9 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Neutron deleted interface dbcf41fa-6220-40e4-9937-dfb775d3d257; detaching it from the instance and deleting it from the info cache
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-3d56995f-b6c9-4899-a9f2-5d9dee6d9504 req-8c0dcdf1-d151-41b9-9f6e-389bee952cf9 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:08 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Took 0.87 seconds to deallocate network for instance.
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-3d56995f-b6c9-4899-a9f2-5d9dee6d9504 req-8c0dcdf1-d151-41b9-9f6e-389bee952cf9 service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Detach interface failed, port_id=dbcf41fa-6220-40e4-9937-dfb775d3d257, reason: Instance b3b4709e-7241-43e6-8300-40efe1b1bb39 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:16:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:09 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Deleted allocations for instance b3b4709e-7241-43e6-8300-40efe1b1bb39
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-839f6ba4-47f1-47c7-9903-c159218c9923 tempest-AttachVolumeShelveTestJSON-1668474455 tempest-AttachVolumeShelveTestJSON-1668474455-project-member] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.466s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] Acquiring lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] Lock "b3b4709e-7241-43e6-8300-40efe1b1bb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] No waiting events found dispatching network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:09 user nova-compute[74903]: WARNING nova.compute.manager [req-aa422d95-f9cf-47e0-8c93-65fb26cea995 req-abb15495-42be-4a7f-b301-b4cad16c384c service nova] [instance: b3b4709e-7241-43e6-8300-40efe1b1bb39] Received unexpected event network-vif-plugged-dbcf41fa-6220-40e4-9937-dfb775d3d257 for instance with vm_state deleted and task_state None.
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:09 user nova-compute[74903]: INFO nova.compute.manager [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Terminating instance
Nov 06 06:16:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Instance destroyed successfully.
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lazy-loading 'resources' on Instance uuid 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-823018447',display_name='tempest-VolumesAdminNegativeTest-server-823018447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-823018447',id=29,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuS+1Ys/XmhLwrST+A7ynDQl815K0Nc/tAOGQG4gLlagc31rTjI3fwgJECG2ITcsIbTPzRo0/w7MBqAPmkSc5DMG4Vj/Xy0NvuY2GA56OZV8RgL2H/+4eR+/LHoeUEsFw==',key_name='tempest-keypair-1641403369',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:08:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a48326e9015488594cdc613e41c7737',ramdisk_id='',reservation_id='r-hvmh0ba0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-55869565',owner_user_name='tempest-VolumesAdminNegativeTest-55869565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:08:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a284ec2f23734152a20aeb9658e08f5c',uuid=33a299c1-0d52-464c-8ca9-b3fd49f43ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converting VIF {"id": "027a8450-74fc-47bc-a736-5e446e737bd3", "address": "fa:16:3e:ed:eb:27", "network": {"id": "040d92c5-0590-4485-9607-eae6543c4034", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-118677749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a48326e9015488594cdc613e41c7737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027a8450-74", "ovs_interfaceid": "027a8450-74fc-47bc-a736-5e446e737bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_vif [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027a8450-74, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca66e0f9-9d97-4d82-a5ab-99b2c360a345) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:10 user nova-compute[74903]: INFO os_vif [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:eb:27,bridge_name='br-int',has_traffic_filtering=True,id=027a8450-74fc-47bc-a736-5e446e737bd3,network=Network(040d92c5-0590-4485-9607-eae6543c4034),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027a8450-74')
Nov 06 06:16:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Deleting instance files /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7_del
Nov 06 06:16:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Deletion of /opt/stack/data/nova/instances/33a299c1-0d52-464c-8ca9-b3fd49f43ef7_del complete
Nov 06 06:16:10 user nova-compute[74903]: INFO nova.compute.manager [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc req-e256d0ed-9091-466b-9256-240cf58eb49d service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event volume-reimaged-f5099a81-297c-4ddd-afbc-3767e9f86892 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc req-e256d0ed-9091-466b-9256-240cf58eb49d service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc req-e256d0ed-9091-466b-9256-240cf58eb49d service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc req-e256d0ed-9091-466b-9256-240cf58eb49d service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc req-e256d0ed-9091-466b-9256-240cf58eb49d service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Processing event volume-reimaged-f5099a81-297c-4ddd-afbc-3767e9f86892 {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance event wait completed in 52 seconds for volume-reimaged {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:16:10 user nova-compute[74903]: INFO nova.virt.block_device [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Booting with volume f5099a81-297c-4ddd-afbc-3767e9f86892 at /dev/vda
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.utils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae226c6f-7525-4451-8e7c-9a91f8a3dff7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbaef84-2dd3-41af-8e55-f6680f670e58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11bf29-90e3-498a-b6e2-d3cc45a9a6dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c76ab-e38d-4990-a815-c63699de2bb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:16:10 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:16:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850f5b0-1ad5-4be1-b434-af2219888808]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG os_brick.utils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:16:10 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating existing volume attachment record: 2badc6ed-64a9-444d-be64-4832eb9cedf4 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:11 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Took 0.80 seconds to deallocate network for instance.
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b7ff861e-14c4-420f-8769-6c2ceb308eee req-4beb05e4-bec5-48cd-b8d9-6372d77dd410 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-vif-deleted-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:11 user nova-compute[74903]: INFO nova.compute.manager [req-b7ff861e-14c4-420f-8769-6c2ceb308eee req-4beb05e4-bec5-48cd-b8d9-6372d77dd410 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Neutron deleted interface 027a8450-74fc-47bc-a736-5e446e737bd3; detaching it from the instance and deleting it from the info cache
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.network.neutron [req-b7ff861e-14c4-420f-8769-6c2ceb308eee req-4beb05e4-bec5-48cd-b8d9-6372d77dd410 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b7ff861e-14c4-420f-8769-6c2ceb308eee req-4beb05e4-bec5-48cd-b8d9-6372d77dd410 service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Detach interface failed, port_id=027a8450-74fc-47bc-a736-5e446e737bd3, reason: Instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-vif-unplugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] No waiting events found dispatching network-vif-unplugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:11 user nova-compute[74903]: WARNING nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received unexpected event network-vif-unplugged-027a8450-74fc-47bc-a736-5e446e737bd3 for instance with vm_state deleted and task_state None.
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Acquiring lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] No waiting events found dispatching network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:11 user nova-compute[74903]: WARNING nova.compute.manager [req-a33794e2-709b-4927-ac5f-37f95feea131 req-11551315-2cf1-4d8e-8e6d-f2edf3aab71b service nova] [instance: 33a299c1-0d52-464c-8ca9-b3fd49f43ef7] Received unexpected event network-vif-plugged-027a8450-74fc-47bc-a736-5e446e737bd3 for instance with vm_state deleted and task_state None.
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:16:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:11 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Deleted allocations for instance 33a299c1-0d52-464c-8ca9-b3fd49f43ef7
Nov 06 06:16:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-9668f460-a1fc-4d8b-b25f-db0172dd8029 tempest-VolumesAdminNegativeTest-55869565 tempest-VolumesAdminNegativeTest-55869565-project-member] Lock "33a299c1-0d52-464c-8ca9-b3fd49f43ef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:16:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-changed-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Refreshing instance network info cache due to event network-changed-5461551d-7d52-4759-a4ec-3d8942f088a8. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] Acquiring lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] Acquired lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:16:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Refreshing network info cache for port 5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:16:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updated VIF entry in instance network info cache for port 5461551d-7d52-4759-a4ec-3d8942f088a8. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:16:21 user nova-compute[74903]: DEBUG nova.network.neutron [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-df3e6885-f294-4a78-8456-a981892c5e3a req-5622b292-5092-4d97-a693-9ee1dfb3de93 service nova] Releasing lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:16:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:23 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:16:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:26 user nova-compute[74903]: INFO nova.compute.manager [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Attaching volume cf4181f8-edec-4077-a118-d6017d611000 to /dev/vdb
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b57a0c-4820-4615-b17c-a89d20f07484]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b781d4-32de-4195-b67f-bf2da991ae67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca5a4c-1e5a-46d2-bbf4-c05cafcdae4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f018100c-76c4-4296-b394-d7c9b9c218cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:16:26 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:16:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a26e50-7da4-4181-83d4-ed21843066c6]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating existing volume attachment record: 225df4cd-87f7-4322-ad14-e7019b6c99e8 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:16:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:28 user nova-compute[74903]: INFO nova.compute.manager [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Terminating instance
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-unplugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] No waiting events found dispatching network-vif-unplugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-56970a14-5cbf-42b9-9920-819e11618971 req-e62a2069-b32c-4985-9bb0-29500d8bf4d1 service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-unplugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Instance destroyed successfully.
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lazy-loading 'resources' on Instance uuid 127b0dcc-cddc-41a1-b66f-42b1eee09849 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T05:55:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1312529727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1312529727',id=1,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T05:55:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af82cdc03f0241bb8de82b8fb9d7a66c',ramdisk_id='',reservation_id='r-gnvfnb4z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-261817602',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T05:57:06Z,user_data=None,user_id='8d10322732ce4e93b049be06ad946cab',uuid=127b0dcc-cddc-41a1-b66f-42b1eee09849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converting VIF {"id": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "address": "fa:16:3e:df:31:bf", "network": {"id": "e28a0153-7af3-444e-9bab-3e43385edc9c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2004811712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af82cdc03f0241bb8de82b8fb9d7a66c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbb94c84-40", "ovs_interfaceid": "fbb94c84-40ce-49b3-8206-aa5e3619a63b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG os_vif [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbb94c84-40, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b744f700-660b-4191-a75c-ebb00ef47415) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:28 user nova-compute[74903]: INFO os_vif [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:31:bf,bridge_name='br-int',has_traffic_filtering=True,id=fbb94c84-40ce-49b3-8206-aa5e3619a63b,network=Network(e28a0153-7af3-444e-9bab-3e43385edc9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbb94c84-40')
Nov 06 06:16:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Deleting instance files /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849_del
Nov 06 06:16:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Deletion of /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849_del complete
Nov 06 06:16:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000001, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/127b0dcc-cddc-41a1-b66f-42b1eee09849/disk
Nov 06 06:16:29 user nova-compute[74903]: INFO nova.compute.manager [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 06 06:16:29 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:16:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:16:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=25.356914520263672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 127b0dcc-cddc-41a1-b66f-42b1eee09849 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 82322fae-3f99-4324-b0b3-3098f01f87fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:29 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:16:29 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Took 0.87 seconds to deallocate network for instance.
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:30 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Deleted allocations for instance 127b0dcc-cddc-41a1-b66f-42b1eee09849
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f0a81573-5235-44e3-80e3-27bd86a0913e tempest-ServerBootFromVolumeStableRescueTest-261817602 tempest-ServerBootFromVolumeStableRescueTest-261817602-project-member] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] Acquiring lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] Lock "127b0dcc-cddc-41a1-b66f-42b1eee09849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] No waiting events found dispatching network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:30 user nova-compute[74903]: WARNING nova.compute.manager [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received unexpected event network-vif-plugged-fbb94c84-40ce-49b3-8206-aa5e3619a63b for instance with vm_state deleted and task_state None.
Nov 06 06:16:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f4ee56b-8fe8-4d27-ba62-80d5272e7e23 req-75ddb287-6544-47e6-a4f7-87fcb30b518a service nova] [instance: 127b0dcc-cddc-41a1-b66f-42b1eee09849] Received event network-vif-deleted-fbb94c84-40ce-49b3-8206-aa5e3619a63b {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:16:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Creating image(s)
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Ensure instance console log exists: /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start _get_guest_xml network_info=[{"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82322fae-3f99-4324-b0b3-3098f01f87fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5099a81-297c-4ddd-afbc-3767e9f86892', 'serial': 'f5099a81-297c-4ddd-afbc-3767e9f86892'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '2badc6ed-64a9-444d-be64-4832eb9cedf4', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:16:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 06:16:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82322fae-3f99-4324-b0b3-3098f01f87fa {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:16:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:16:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:16:32 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbad5d5d-87dc-41b4-bfeb-32519a29ca6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:16:32 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55aaee7-0c13-451c-92a4-494b9099c3af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892] added
Nov 06 06:16:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cdd5ff-4f2b-41cd-b174-ffa09088d94e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.240s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2697e-4846-477b-873a-681fd1d87cb2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKNuXxdC {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKNuXxdC" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5e04ec-e716-4b40-8a0e-6726a099d233]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKNuXxdC'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf281326-025c-4e09-9636-99895e372dd3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e136a90-2190-4dbd-abf6-183f56ff4c79]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:16:32 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:16:32 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:16:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:16:32 user nova-compute[74903]: : NotImplementedError
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[969dae6d-2be8-40e9-8b40-a29153910184]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]
Nov 06 06:16:32 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.
Nov 06 06:16:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a7641-95bf-4d8a-a297-63173d8c27f3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8a434c-6e19-443f-8bbf-4296496211c7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:16:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:16:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c03baf-b964-4411-a0cb-1ac69a314432]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:16:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '26264663262323632', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264663262323632', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1131133262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:16:33 user nova-compute[74903]:   <uuid>82322fae-3f99-4324-b0b3-3098f01f87fa</uuid>
Nov 06 06:16:33 user nova-compute[74903]:   <name>instance-00000021</name>
Nov 06 06:16:33 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:16:33 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:16:33 user nova-compute[74903]:   <metadata>
Nov 06 06:16:33 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:16:33 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:16:33 user nova-compute[74903]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1131133262</nova:name>
Nov 06 06:16:33 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:16:32</nova:creationTime>
Nov 06 06:16:33 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:16:33 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:16:33 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:16:33 user nova-compute[74903]:       <nova:owner>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:user uuid="4ab10b231ebe451e90c8b8b2583bfc91">tempest-ServerActionsV293TestJSON-692224141-project-member</nova:user>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:project uuid="9c457df19cfa497e839b005243324307">tempest-ServerActionsV293TestJSON-692224141</nova:project>
Nov 06 06:16:33 user nova-compute[74903]:       </nova:owner>
Nov 06 06:16:33 user nova-compute[74903]:       <nova:ports>
Nov 06 06:16:33 user nova-compute[74903]:         <nova:port uuid="dc00fca4-8c23-4173-a597-8781b02a66b9">
Nov 06 06:16:33 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 06:16:33 user nova-compute[74903]:         </nova:port>
Nov 06 06:16:33 user nova-compute[74903]:       </nova:ports>
Nov 06 06:16:33 user nova-compute[74903]:     </nova:instance>
Nov 06 06:16:33 user nova-compute[74903]:   </metadata>
Nov 06 06:16:33 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:16:33 user nova-compute[74903]:     <system>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="serial">82322fae-3f99-4324-b0b3-3098f01f87fa</entry>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="uuid">82322fae-3f99-4324-b0b3-3098f01f87fa</entry>
Nov 06 06:16:33 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:16:33 user nova-compute[74903]:     </system>
Nov 06 06:16:33 user nova-compute[74903]:   </sysinfo>
Nov 06 06:16:33 user nova-compute[74903]:   <os>
Nov 06 06:16:33 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:16:33 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:16:33 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:16:33 user nova-compute[74903]:   </os>
Nov 06 06:16:33 user nova-compute[74903]:   <features>
Nov 06 06:16:33 user nova-compute[74903]:     <acpi/>
Nov 06 06:16:33 user nova-compute[74903]:     <apic/>
Nov 06 06:16:33 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:16:33 user nova-compute[74903]:   </features>
Nov 06 06:16:33 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:16:33 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:16:33 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:16:33 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:16:33 user nova-compute[74903]:   </clock>
Nov 06 06:16:33 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:16:33 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:16:33 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:16:33 user nova-compute[74903]:   </cpu>
Nov 06 06:16:33 user nova-compute[74903]:   <devices>
Nov 06 06:16:33 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:16:33 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:16:33 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:16:33 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:16:33 user nova-compute[74903]:       <serial>f5099a81-297c-4ddd-afbc-3767e9f86892</serial>
Nov 06 06:16:33 user nova-compute[74903]:     </disk>
Nov 06 06:16:33 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:16:33 user nova-compute[74903]:       <mac address="fa:16:3e:cb:98:5d"/>
Nov 06 06:16:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:16:33 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:16:33 user nova-compute[74903]:       <target dev="tapdc00fca4-8c"/>
Nov 06 06:16:33 user nova-compute[74903]:     </interface>
Nov 06 06:16:33 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:16:33 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa/console.log" append="off"/>
Nov 06 06:16:33 user nova-compute[74903]:     </serial>
Nov 06 06:16:33 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:16:33 user nova-compute[74903]:     <video>
Nov 06 06:16:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:16:33 user nova-compute[74903]:     </video>
Nov 06 06:16:33 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:16:33 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:16:33 user nova-compute[74903]:     </rng>
Nov 06 06:16:33 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:16:33 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:16:33 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:16:33 user nova-compute[74903]:     </memballoon>
Nov 06 06:16:33 user nova-compute[74903]:   </devices>
Nov 06 06:16:33 user nova-compute[74903]: </domain>
Nov 06 06:16:33 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1131133262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG os_vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '907ce680-e355-564e-bc48-aaac3e02ab9a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc00fca4-8c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc00fca4-8c, col_values=(('qos', UUID('6f06c4a8-9455-479e-bf64-3f767327c98f')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc00fca4-8c, col_values=(('external_ids', {'iface-id': 'dc00fca4-8c23-4173-a597-8781b02a66b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:98:5d', 'vm-uuid': '82322fae-3f99-4324-b0b3-3098f01f87fa'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:33 user nova-compute[74903]: INFO os_vif [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c')
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:16:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] No VIF found with MAC fa:16:3e:cb:98:5d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:35 user nova-compute[74903]: WARNING nova.compute.manager [req-1ae27c26-09da-4882-86a1-39bbad1797e2 req-9f3f5a2c-4bf9-4ff3-ad9d-b387abe5bc07 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:16:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance spawned successfully.
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:16:37 user nova-compute[74903]: WARNING nova.compute.manager [req-3696c33a-c14d-43d9-87ba-5fed74999bb3 req-9a202df9-6069-47ba-afd4-6e0963bac58b service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state active and task_state rebuild_spawning.
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74903) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 06:16:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43cfee9c-7cf4-4a89-a24e-43bcbfd38fdc tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:16:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:16:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:16:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:16:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:16:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:16:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDvxegaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:17:11 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:17:11 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:17:11 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[37744328-b568-48cb-86c3-7cf9ac8a4b37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:17:11 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb025440-f120-450d-8de0-870423218185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000] added
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20afb7e6-a934-4c4a-b972-cf48563d4331]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[90703ca0-525e-43b8-8199-1945812f6c68]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDvxegaR {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDvxegaR" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2dc5e-6b71-4bd8-855b-6f13ecfa1a6c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YDvxegaR'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[33071543-b74e-49e8-b92f-780da780418b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a314384-6af9-4031-aecd-c01ba0bd8536]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e016a2-785c-47d6-a8af-f724312d23e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260]
Nov 06 06:17:11 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260] successful.
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[770be905-f7a9-49cd-8387-7e705c394692]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdaae8-903f-409a-81e9-f0b910ce8e6d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:17:11 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4192cf9-3da3-4792-b396-0419f650789d]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDvxegaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23263613632383066', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263613632383066', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:17:12 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:17:12 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:17:12 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:17:12 user nova-compute[74903]:   <serial>cf4181f8-edec-4077-a118-d6017d611000</serial>
Nov 06 06:17:12 user nova-compute[74903]: </disk>
Nov 06 06:17:12 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:7b:3a:14, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:17:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f45ba581-a85f-45b9-8154-b666d422b7b9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.315s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:17:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:17:16 user nova-compute[74903]: INFO nova.compute.claims [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Claim successful on node user
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:17:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.policy [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8673337612a54ca0a89d180a830cbaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ac2801ad3f4b75bc98d85071d479c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:17:16 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Creating image(s)
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.170s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk 1073741824" returned: 0 in 0.054s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Successfully created port: 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Cannot resize image /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Ensure instance console log exists: /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Successfully updated port: 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquired lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-changed-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Refreshing instance network info cache due to event network-changed-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] Acquiring lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:17:17 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updating instance_info_cache with network_info: [{"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Releasing lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Instance network_info: |[{"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] Acquired lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Refreshing network info cache for port 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Start _get_guest_xml network_info=[{"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:17:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2033096112',display_name='tempest-AttachVolumeNegativeTest-server-2033096112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2033096112',id=35,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9UrNi2Au6hyOrtCld23FFTu3GgtThEYSzW0T58accg0SNAoHtaqpZ4VmKw7Yxfg2qP0jNxbenPMLMYzUk/9jI9R80XQUxIL8pKAS8/JmHesstypXfYnStDhiQSk12mpQ==',key_name='tempest-keypair-1693203703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-05q7p1nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=cf488c8c-d9d5-4349-b00b-306c7bddc516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.objects.instance [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'pci_devices' on Instance uuid cf488c8c-d9d5-4349-b00b-306c7bddc516 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:17:18 user nova-compute[74903]:   <uuid>cf488c8c-d9d5-4349-b00b-306c7bddc516</uuid>
Nov 06 06:17:18 user nova-compute[74903]:   <name>instance-00000023</name>
Nov 06 06:17:18 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:17:18 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:17:18 user nova-compute[74903]:   <metadata>
Nov 06 06:17:18 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:17:18 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2033096112</nova:name>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:17:18</nova:creationTime>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:17:18 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:17:18 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:owner>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:user uuid="8673337612a54ca0a89d180a830cbaf5">tempest-AttachVolumeNegativeTest-1944196622-project-member</nova:user>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:project uuid="b9ac2801ad3f4b75bc98d85071d479c6">tempest-AttachVolumeNegativeTest-1944196622</nova:project>
Nov 06 06:17:18 user nova-compute[74903]:       </nova:owner>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:17:18 user nova-compute[74903]:       <nova:ports>
Nov 06 06:17:18 user nova-compute[74903]:         <nova:port uuid="7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5">
Nov 06 06:17:18 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:17:18 user nova-compute[74903]:         </nova:port>
Nov 06 06:17:18 user nova-compute[74903]:       </nova:ports>
Nov 06 06:17:18 user nova-compute[74903]:     </nova:instance>
Nov 06 06:17:18 user nova-compute[74903]:   </metadata>
Nov 06 06:17:18 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:17:18 user nova-compute[74903]:     <system>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="serial">cf488c8c-d9d5-4349-b00b-306c7bddc516</entry>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="uuid">cf488c8c-d9d5-4349-b00b-306c7bddc516</entry>
Nov 06 06:17:18 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:17:18 user nova-compute[74903]:     </system>
Nov 06 06:17:18 user nova-compute[74903]:   </sysinfo>
Nov 06 06:17:18 user nova-compute[74903]:   <os>
Nov 06 06:17:18 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:17:18 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:17:18 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:17:18 user nova-compute[74903]:   </os>
Nov 06 06:17:18 user nova-compute[74903]:   <features>
Nov 06 06:17:18 user nova-compute[74903]:     <acpi/>
Nov 06 06:17:18 user nova-compute[74903]:     <apic/>
Nov 06 06:17:18 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:17:18 user nova-compute[74903]:   </features>
Nov 06 06:17:18 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:17:18 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:17:18 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:17:18 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:17:18 user nova-compute[74903]:   </clock>
Nov 06 06:17:18 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:17:18 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:17:18 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:17:18 user nova-compute[74903]:   </cpu>
Nov 06 06:17:18 user nova-compute[74903]:   <devices>
Nov 06 06:17:18 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:17:18 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:17:18 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk"/>
Nov 06 06:17:18 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:17:18 user nova-compute[74903]:     </disk>
Nov 06 06:17:18 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:17:18 user nova-compute[74903]:       <mac address="fa:16:3e:e3:99:ed"/>
Nov 06 06:17:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:17:18 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:17:18 user nova-compute[74903]:       <target dev="tap7e2def6f-42"/>
Nov 06 06:17:18 user nova-compute[74903]:     </interface>
Nov 06 06:17:18 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:17:18 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/console.log" append="off"/>
Nov 06 06:17:18 user nova-compute[74903]:     </serial>
Nov 06 06:17:18 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:17:18 user nova-compute[74903]:     <video>
Nov 06 06:17:18 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:17:18 user nova-compute[74903]:     </video>
Nov 06 06:17:18 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:17:18 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:17:18 user nova-compute[74903]:     </rng>
Nov 06 06:17:18 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:17:18 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:17:18 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:17:18 user nova-compute[74903]:     </memballoon>
Nov 06 06:17:18 user nova-compute[74903]:   </devices>
Nov 06 06:17:18 user nova-compute[74903]: </domain>
Nov 06 06:17:18 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2033096112',display_name='tempest-AttachVolumeNegativeTest-server-2033096112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2033096112',id=35,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9UrNi2Au6hyOrtCld23FFTu3GgtThEYSzW0T58accg0SNAoHtaqpZ4VmKw7Yxfg2qP0jNxbenPMLMYzUk/9jI9R80XQUxIL8pKAS8/JmHesstypXfYnStDhiQSk12mpQ==',key_name='tempest-keypair-1693203703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-05q7p1nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:17:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=cf488c8c-d9d5-4349-b00b-306c7bddc516,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG os_vif [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48d50104-95ef-5325-bc6d-ab8b76d10354', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e2def6f-42, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e2def6f-42, col_values=(('qos', UUID('175a3ebc-b8d0-44e6-a5d9-d96f26fcdcb4')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e2def6f-42, col_values=(('external_ids', {'iface-id': '7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:99:ed', 'vm-uuid': 'cf488c8c-d9d5-4349-b00b-306c7bddc516'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:18 user nova-compute[74903]: INFO os_vif [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42')
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:e3:99:ed, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updated VIF entry in instance network info cache for port 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updating instance_info_cache with network_info: [{"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c885c4b1-f2c3-4709-8c2d-29c3597b31df req-6027c148-3d5b-4814-9b60-cd75e0100173 service nova] Releasing lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Skipping network cache update for instance because it is Building. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] No waiting events found dispatching network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:19 user nova-compute[74903]: WARNING nova.compute.manager [req-38e4bc4d-5f96-4046-b8fb-f5b0e22f21d5 req-3de9b974-d875-42d6-bf71-0cb6e117541b service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received unexpected event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 for instance with vm_state building and task_state spawning.
Nov 06 06:17:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:17:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:17:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] No waiting events found dispatching network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:22 user nova-compute[74903]: WARNING nova.compute.manager [req-bd112501-b0e4-4467-a064-d1696d90889b req-734070af-ba75-4c6d-a803-86c6310f55cc service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received unexpected event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 for instance with vm_state building and task_state spawning.
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:17:22 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Instance spawned successfully.
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:22 user nova-compute[74903]: INFO nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 06 06:17:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:17:22 user nova-compute[74903]: INFO nova.compute.manager [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Took 6.38 seconds to build instance.
Nov 06 06:17:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-94ca5359-fde2-47ae-b170-108d98046ef1 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.498s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:23 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:23 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:17:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:32 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8483MB free_disk=25.370025634765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 82322fae-3f99-4324-b0b3-3098f01f87fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance cf488c8c-d9d5-4349-b00b-306c7bddc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:17:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:17:34 user nova-compute[74903]: INFO nova.compute.claims [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Claim successful on node user
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:17:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.policy [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5ebd68316d430a86749b05b13ebf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0ee9f9d310436fb18fb51fe1c2b3b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:17:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Creating image(s)
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.224s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk 1073741824" returned: 0 in 0.107s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Successfully created port: f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Cannot resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Ensure instance console log exists: /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Successfully updated port: f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-changed-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Refreshing instance network info cache due to event network-changed-f6531ffa-c360-4977-94ba-25ccf8e2474e. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:17:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance network_info: |[{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Refreshing network info cache for port f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start _get_guest_xml network_info=[{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:17:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:17:37 user nova-compute[74903]:   <uuid>8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</uuid>
Nov 06 06:17:37 user nova-compute[74903]:   <name>instance-00000024</name>
Nov 06 06:17:37 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:17:37 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:17:37 user nova-compute[74903]:   <metadata>
Nov 06 06:17:37 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:17:37 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeTestJSON-server-534899196</nova:name>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:17:37</nova:creationTime>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:17:37 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:17:37 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:owner>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:user uuid="bd5ebd68316d430a86749b05b13ebf21">tempest-AttachVolumeTestJSON-2127223018-project-member</nova:user>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:project uuid="5f0ee9f9d310436fb18fb51fe1c2b3b0">tempest-AttachVolumeTestJSON-2127223018</nova:project>
Nov 06 06:17:37 user nova-compute[74903]:       </nova:owner>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:17:37 user nova-compute[74903]:       <nova:ports>
Nov 06 06:17:37 user nova-compute[74903]:         <nova:port uuid="f6531ffa-c360-4977-94ba-25ccf8e2474e">
Nov 06 06:17:37 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:17:37 user nova-compute[74903]:         </nova:port>
Nov 06 06:17:37 user nova-compute[74903]:       </nova:ports>
Nov 06 06:17:37 user nova-compute[74903]:     </nova:instance>
Nov 06 06:17:37 user nova-compute[74903]:   </metadata>
Nov 06 06:17:37 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:17:37 user nova-compute[74903]:     <system>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="serial">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="uuid">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:17:37 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:17:37 user nova-compute[74903]:     </system>
Nov 06 06:17:37 user nova-compute[74903]:   </sysinfo>
Nov 06 06:17:37 user nova-compute[74903]:   <os>
Nov 06 06:17:37 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:17:37 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:17:37 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:17:37 user nova-compute[74903]:   </os>
Nov 06 06:17:37 user nova-compute[74903]:   <features>
Nov 06 06:17:37 user nova-compute[74903]:     <acpi/>
Nov 06 06:17:37 user nova-compute[74903]:     <apic/>
Nov 06 06:17:37 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:17:37 user nova-compute[74903]:   </features>
Nov 06 06:17:37 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:17:37 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:17:37 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:17:37 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:17:37 user nova-compute[74903]:   </clock>
Nov 06 06:17:37 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:17:37 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:17:37 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:17:37 user nova-compute[74903]:   </cpu>
Nov 06 06:17:37 user nova-compute[74903]:   <devices>
Nov 06 06:17:37 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:17:37 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:17:37 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk"/>
Nov 06 06:17:37 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:17:37 user nova-compute[74903]:     </disk>
Nov 06 06:17:37 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:17:37 user nova-compute[74903]:       <mac address="fa:16:3e:58:e8:a8"/>
Nov 06 06:17:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:17:37 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:17:37 user nova-compute[74903]:       <target dev="tapf6531ffa-c3"/>
Nov 06 06:17:37 user nova-compute[74903]:     </interface>
Nov 06 06:17:37 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:17:37 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/console.log" append="off"/>
Nov 06 06:17:37 user nova-compute[74903]:     </serial>
Nov 06 06:17:37 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:17:37 user nova-compute[74903]:     <video>
Nov 06 06:17:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:17:37 user nova-compute[74903]:     </video>
Nov 06 06:17:37 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:17:37 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:17:37 user nova-compute[74903]:     </rng>
Nov 06 06:17:37 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:17:37 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:17:37 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:17:37 user nova-compute[74903]:     </memballoon>
Nov 06 06:17:37 user nova-compute[74903]:   </devices>
Nov 06 06:17:37 user nova-compute[74903]: </domain>
Nov 06 06:17:37 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:17:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG os_vif [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27311ea9-d5bc-5ebe-893b-7d45b7a71a7b', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6531ffa-c3, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6531ffa-c3, col_values=(('qos', UUID('4ec31771-3c7a-421a-b41b-600660ae6129')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6531ffa-c3, col_values=(('external_ids', {'iface-id': 'f6531ffa-c360-4977-94ba-25ccf8e2474e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e8:a8', 'vm-uuid': '8d8c3ba8-856b-4e95-800d-7d4b8ab946fc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:37 user nova-compute[74903]: INFO os_vif [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No VIF found with MAC fa:16:3e:58:e8:a8, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updated VIF entry in instance network info cache for port f6531ffa-c360-4977-94ba-25ccf8e2474e. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-7bfcdda0-ed68-4a36-a399-fcb780e155b7 req-422534c2-1bef-472a-af38-c9c9939ed3d9 service nova] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:17:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:39 user nova-compute[74903]: WARNING nova.compute.manager [req-fe2b349e-265d-4b5d-bc24-270de698776b req-27b79d74-f680-4237-be74-8fa8b2b073c7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state building and task_state spawning.
Nov 06 06:17:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:17:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance spawned successfully.
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:17:41 user nova-compute[74903]: INFO nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 06 06:17:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:41 user nova-compute[74903]: WARNING nova.compute.manager [req-5fb42611-38f8-486c-92bd-97c00b36d6be req-3418d9a3-223c-4180-9c85-59fef8a0388e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state building and task_state spawning.
Nov 06 06:17:41 user nova-compute[74903]: INFO nova.compute.manager [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Took 6.92 seconds to build instance.
Nov 06 06:17:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-69ccf76b-c4ee-4ced-9907-762b20bc3122 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.060s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:49 user nova-compute[74903]: INFO nova.compute.manager [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Terminating instance
Nov 06 06:17:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-d29d5c0f-c00e-4089-af9b-4d4b220d8080 req-69b2912e-4076-4896-9f55-7e5c2e3d1a4f service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-unplugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:17:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Instance destroyed successfully.
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lazy-loading 'resources' on Instance uuid 82322fae-3f99-4324-b0b3-3098f01f87fa {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T06:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1131133262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1930734297',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDa7hM4rUa9prwdNz50ekUOkUleih33y8C6kuBDZIumoWPLBWoqvokw1XvLBS1av8CqhEFoWgdm5/Y11eZkuVfvyxHzj5b2FaYmSGzj1laepwxkRYYe1XoSuPMbCwWJ7g==',key_name='tempest-keypair-568646726',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c457df19cfa497e839b005243324307',ramdisk_id='',reservation_id='r-uuqrlq9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-692224141',owner_user_name='tempest-ServerActionsV293TestJSON-692224141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ab10b231ebe451e90c8b8b2583bfc91',uuid=82322fae-3f99-4324-b0b3-3098f01f87fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converting VIF {"id": "dc00fca4-8c23-4173-a597-8781b02a66b9", "address": "fa:16:3e:cb:98:5d", "network": {"id": "d59b3a1d-db81-4383-af5e-34b93737554e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1391881326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c457df19cfa497e839b005243324307", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc00fca4-8c", "ovs_interfaceid": "dc00fca4-8c23-4173-a597-8781b02a66b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_vif [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc00fca4-8c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f06c4a8-9455-479e-bf64-3f767327c98f) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:17:50 user nova-compute[74903]: INFO os_vif [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:98:5d,bridge_name='br-int',has_traffic_filtering=True,id=dc00fca4-8c23-4173-a597-8781b02a66b9,network=Network(d59b3a1d-db81-4383-af5e-34b93737554e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc00fca4-8c')
Nov 06 06:17:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKNuXxdC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:17:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bba5a4-83e0-4557-8350-0172dda00158]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:17:50 user nova-compute[74903]: No targets found.
Nov 06 06:17:50 user nova-compute[74903]: iSNS:
Nov 06 06:17:50 user nova-compute[74903]: No targets found.
Nov 06 06:17:50 user nova-compute[74903]: STATIC:
Nov 06 06:17:50 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892
Nov 06 06:17:50 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:17:50 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:17:50 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000
Nov 06 06:17:50 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:17:50 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:17:50 user nova-compute[74903]: FIRMWARE:
Nov 06 06:17:50 user nova-compute[74903]: No targets found.
Nov 06 06:17:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:17:50 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:17:50 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87da7ec-f795-445b-a216-80075ec78bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7da765-7eeb-4510-ba11-30cd26dd75ea]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:50 user nova-compute[74903]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:17:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 (non-flash)
Nov 06 06:17:50 user nova-compute[74903]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:17:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4891f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d00c49-24a9-4685-b4e8-9e876f4f837e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee4d85c-d36b-4a4f-bf4e-b14bbf9e2c83]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b4b5a-5f77-4b38-9c1a-78a3e62ed073]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa717636-ffe4-4b9a-b281-6d8c0f6ef39b]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[446edc41-774a-4e84-8109-16f16c54d69d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdabd4-fe9c-4d80-8f5b-40adc5d8046b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260]
Nov 06 06:17:51 user nova-compute[74903]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892, portal: 172.16.0.220,3260] successful.
Nov 06 06:17:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5099a81-297c-4ddd-afbc-3767e9f86892 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a1e5ac-bb5c-47f9-b037-204030055f8c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] <== disconnect_volume: return (378ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:17:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deleting instance files /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa_del
Nov 06 06:17:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deletion of /opt/stack/data/nova/instances/82322fae-3f99-4324-b0b3-3098f01f87fa_del complete
Nov 06 06:17:51 user nova-compute[74903]: INFO nova.compute.manager [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 06 06:17:51 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:17:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] Acquiring lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] No waiting events found dispatching network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:17:52 user nova-compute[74903]: WARNING nova.compute.manager [req-a7554793-b907-4802-860b-fa01cd536787 req-475126cc-d931-4f89-a76e-550dc3882950 service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received unexpected event network-vif-plugged-dc00fca4-8c23-4173-a597-8781b02a66b9 for instance with vm_state active and task_state deleting.
Nov 06 06:17:52 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:17:52 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Took 1.29 seconds to deallocate network for instance.
Nov 06 06:17:53 user nova-compute[74903]: INFO nova.compute.manager [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Took 1.19 seconds to detach 1 volumes for instance.
Nov 06 06:17:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Deleting volume: f5099a81-297c-4ddd-afbc-3767e9f86892 {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:17:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:17:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:17:53 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:17:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:17:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:54 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Deleted allocations for instance 82322fae-3f99-4324-b0b3-3098f01f87fa
Nov 06 06:17:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0af71faa-ae47-4fb0-abb1-1d695071ebb3 tempest-ServerActionsV293TestJSON-692224141 tempest-ServerActionsV293TestJSON-692224141-project-member] Lock "82322fae-3f99-4324-b0b3-3098f01f87fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.363s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:17:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-6c0bdcaa-c08a-4a9d-8e4f-20d609bf3cb8 req-1424e8fe-bef9-4e97-874d-4e0850c7bd6e service nova] [instance: 82322fae-3f99-4324-b0b3-3098f01f87fa] Received event network-vif-deleted-dc00fca4-8c23-4173-a597-8781b02a66b9 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:17:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:17:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:18:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:18:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:18:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:18:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:18:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.300697326660156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance cf488c8c-d9d5-4349-b00b-306c7bddc516 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:18:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:18:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:18:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:18:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:18:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:18:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:18:40 user nova-compute[74903]: INFO nova.compute.claims [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Claim successful on node user
Nov 06 06:18:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:18:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:18:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:18:41 user nova-compute[74903]: DEBUG nova.policy [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:18:41 user nova-compute[74903]: INFO nova.virt.block_device [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Booting with volume snapshot c90f7a85-271c-48de-be43-5e097f3a41e9 at /dev/vda
Nov 06 06:18:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Successfully created port: 40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:18:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Successfully updated port: 40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-changed-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Refreshing instance network info cache due to event network-changed-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] Acquiring lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updating instance_info_cache with network_info: [{"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Instance network_info: |[{"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] Acquired lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:18:42 user nova-compute[74903]: DEBUG nova.network.neutron [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Refreshing network info cache for port 40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:18:43 user nova-compute[74903]: DEBUG nova.network.neutron [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updated VIF entry in instance network info cache for port 40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:18:43 user nova-compute[74903]: DEBUG nova.network.neutron [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updating instance_info_cache with network_info: [{"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:18:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-291c239e-1170-4322-883b-c43dd7325ba2 req-f6c8ad08-068f-429c-9a4e-cb6a1f7e8185 service nova] Releasing lock "refresh_cache-1c59014f-48fa-438c-a5a0-8d7f2d117bd7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:18:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.utils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[931729c6-8632-4ae7-ab9c-fae788bf863c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[80678d6b-3227-4146-a22c-44a3da0263e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cd706-58e0-44d1-85c7-07555f355135]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8671ee-3557-40b6-8d66-3d06dad28266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:18:46 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:18:46 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[beafe37e-b59e-4a52-9502-cc16141c9e17]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:18:46 user nova-compute[74903]: DEBUG os_brick.utils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:18:47 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updating existing volume attachment record: 9c522f32-d611-4933-8d36-264c07c449ec {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:18:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:18:55 user nova-compute[74903]: INFO nova.compute.claims [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Claim successful on node user
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:18:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.policy [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '464230a135f94828b7f04a9bf10a3ab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1b5857e46dc41849562a385ea14ff4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:18:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Creating image(s)
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk 1073741824" returned: 0 in 0.052s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Successfully created port: d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Cannot resize image /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Ensure instance console log exists: /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Successfully updated port: d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing instance network info cache due to event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance network_info: |[{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start _get_guest_xml network_info=[{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:18:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:18:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987042337',display_name='tempest-ServerStableDeviceRescueTest-server-1987042337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1987042337',id=38,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByt1pI2/SsEmmqiAssLT6BTfxA6sUPgigNIlwoLXLrehdOwXtEaY/YlVx5Z+rVvkv+ALYzCRWIBn9D+0jBeFKyO1FN9d56SJpxDf9WBOi1GbRESgsFeGLYNtfrM2SxXqg==',key_name='tempest-keypair-1589938492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1b5857e46dc41849562a385ea14ff4e',ramdisk_id='',reservation_id='r-zpjznmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-263532306',owner_user_name='tempest-ServerStableDeviceRescueTest-263532306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='464230a135f94828b7f04a9bf10a3ab4',uuid=a0337bf8-e941-4b21-8b87-580831eec57f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converting VIF {"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'pci_devices' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:18:57 user nova-compute[74903]:   <uuid>a0337bf8-e941-4b21-8b87-580831eec57f</uuid>
Nov 06 06:18:57 user nova-compute[74903]:   <name>instance-00000026</name>
Nov 06 06:18:57 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:18:57 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:18:57 user nova-compute[74903]:   <metadata>
Nov 06 06:18:57 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:18:57 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1987042337</nova:name>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:18:57</nova:creationTime>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:18:57 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:18:57 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:owner>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:user uuid="464230a135f94828b7f04a9bf10a3ab4">tempest-ServerStableDeviceRescueTest-263532306-project-member</nova:user>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:project uuid="f1b5857e46dc41849562a385ea14ff4e">tempest-ServerStableDeviceRescueTest-263532306</nova:project>
Nov 06 06:18:57 user nova-compute[74903]:       </nova:owner>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:18:57 user nova-compute[74903]:       <nova:ports>
Nov 06 06:18:57 user nova-compute[74903]:         <nova:port uuid="d4b76b36-9cc0-4275-8eb0-90d70d4a0940">
Nov 06 06:18:57 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:18:57 user nova-compute[74903]:         </nova:port>
Nov 06 06:18:57 user nova-compute[74903]:       </nova:ports>
Nov 06 06:18:57 user nova-compute[74903]:     </nova:instance>
Nov 06 06:18:57 user nova-compute[74903]:   </metadata>
Nov 06 06:18:57 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:18:57 user nova-compute[74903]:     <system>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="serial">a0337bf8-e941-4b21-8b87-580831eec57f</entry>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="uuid">a0337bf8-e941-4b21-8b87-580831eec57f</entry>
Nov 06 06:18:57 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:18:57 user nova-compute[74903]:     </system>
Nov 06 06:18:57 user nova-compute[74903]:   </sysinfo>
Nov 06 06:18:57 user nova-compute[74903]:   <os>
Nov 06 06:18:57 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:18:57 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:18:57 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:18:57 user nova-compute[74903]:   </os>
Nov 06 06:18:57 user nova-compute[74903]:   <features>
Nov 06 06:18:57 user nova-compute[74903]:     <acpi/>
Nov 06 06:18:57 user nova-compute[74903]:     <apic/>
Nov 06 06:18:57 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:18:57 user nova-compute[74903]:   </features>
Nov 06 06:18:57 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:18:57 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:18:57 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:18:57 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:18:57 user nova-compute[74903]:   </clock>
Nov 06 06:18:57 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:18:57 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:18:57 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:18:57 user nova-compute[74903]:   </cpu>
Nov 06 06:18:57 user nova-compute[74903]:   <devices>
Nov 06 06:18:57 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:18:57 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:18:57 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk"/>
Nov 06 06:18:57 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:18:57 user nova-compute[74903]:     </disk>
Nov 06 06:18:57 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:18:57 user nova-compute[74903]:       <mac address="fa:16:3e:d7:93:9e"/>
Nov 06 06:18:57 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:18:57 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:18:57 user nova-compute[74903]:       <target dev="tapd4b76b36-9c"/>
Nov 06 06:18:57 user nova-compute[74903]:     </interface>
Nov 06 06:18:57 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:18:57 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/console.log" append="off"/>
Nov 06 06:18:57 user nova-compute[74903]:     </serial>
Nov 06 06:18:57 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:18:57 user nova-compute[74903]:     <video>
Nov 06 06:18:57 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:18:57 user nova-compute[74903]:     </video>
Nov 06 06:18:57 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:18:57 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:18:57 user nova-compute[74903]:     </rng>
Nov 06 06:18:57 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:18:57 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:18:57 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:18:57 user nova-compute[74903]:     </memballoon>
Nov 06 06:18:57 user nova-compute[74903]:   </devices>
Nov 06 06:18:57 user nova-compute[74903]: </domain>
Nov 06 06:18:57 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987042337',display_name='tempest-ServerStableDeviceRescueTest-server-1987042337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1987042337',id=38,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByt1pI2/SsEmmqiAssLT6BTfxA6sUPgigNIlwoLXLrehdOwXtEaY/YlVx5Z+rVvkv+ALYzCRWIBn9D+0jBeFKyO1FN9d56SJpxDf9WBOi1GbRESgsFeGLYNtfrM2SxXqg==',key_name='tempest-keypair-1589938492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1b5857e46dc41849562a385ea14ff4e',ramdisk_id='',reservation_id='r-zpjznmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-263532306',owner_user_name='tempest-ServerStableDeviceRescueTest-263532306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='464230a135f94828b7f04a9bf10a3ab4',uuid=a0337bf8-e941-4b21-8b87-580831eec57f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converting VIF {"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG os_vif [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f69a6494-941c-5217-874b-9dbc87fe6a1a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4b76b36-9c, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4b76b36-9c, col_values=(('qos', UUID('ca8d2863-c27e-4273-9f0f-b76f32fce0d3')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4b76b36-9c, col_values=(('external_ids', {'iface-id': 'd4b76b36-9cc0-4275-8eb0-90d70d4a0940', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:93:9e', 'vm-uuid': 'a0337bf8-e941-4b21-8b87-580831eec57f'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:57 user nova-compute[74903]: INFO os_vif [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c')
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No VIF found with MAC fa:16:3e:d7:93:9e, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated VIF entry in instance network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:18:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e179fb1a-19dc-4e79-9434-de202a1e640c req-ff31849c-6067-41a7-afd6-006f16e01c89 service nova] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:18:59 user nova-compute[74903]: WARNING nova.compute.manager [req-880bd397-66ac-4581-89a5-6634eaaafe4d req-4c270600-d48a-49a1-87b9-fac8c7c4b178 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state building and task_state spawning.
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:18:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:19:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:19:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance spawned successfully.
Nov 06 06:19:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:19:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:02 user nova-compute[74903]: WARNING nova.compute.manager [req-fc91796e-6ac6-4460-adb2-5f0f1398f07c req-c5519fd2-d8ac-4910-92bc-ac072c7ac4b8 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state building and task_state spawning.
Nov 06 06:19:02 user nova-compute[74903]: INFO nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 06 06:19:02 user nova-compute[74903]: DEBUG nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:19:02 user nova-compute[74903]: INFO nova.compute.manager [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Took 6.40 seconds to build instance.
Nov 06 06:19:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84f38cf7-dc01-47de-991d-3c95d34598d8 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.534s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-changed-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Refreshing instance network info cache due to event network-changed-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:19:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] Acquiring lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:19:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] Acquired lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:19:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Refreshing network info cache for port 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:07 user nova-compute[74903]: INFO nova.compute.manager [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Terminating instance
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.network.neutron [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updated VIF entry in instance network info cache for port 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.network.neutron [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updating instance_info_cache with network_info: [{"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ed4386e5-ae64-45c0-8269-36b22c9518f8 req-fe301061-7c8c-4742-a99c-37d11799efb4 service nova] Releasing lock "refresh_cache-cf488c8c-d9d5-4349-b00b-306c7bddc516" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-unplugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] No waiting events found dispatching network-vif-unplugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-58b11aee-1464-4dc9-9deb-9250b4bde986 req-12ff78bf-a5ac-4f33-bb6c-844bbc658999 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-unplugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Instance destroyed successfully.
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'resources' on Instance uuid cf488c8c-d9d5-4349-b00b-306c7bddc516 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2033096112',display_name='tempest-AttachVolumeNegativeTest-server-2033096112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2033096112',id=35,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9UrNi2Au6hyOrtCld23FFTu3GgtThEYSzW0T58accg0SNAoHtaqpZ4VmKw7Yxfg2qP0jNxbenPMLMYzUk/9jI9R80XQUxIL8pKAS8/JmHesstypXfYnStDhiQSk12mpQ==',key_name='tempest-keypair-1693203703',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-05q7p1nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=cf488c8c-d9d5-4349-b00b-306c7bddc516,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "address": "fa:16:3e:e3:99:ed", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2def6f-42", "ovs_interfaceid": "7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG os_vif [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e2def6f-42, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=175a3ebc-b8d0-44e6-a5d9-d96f26fcdcb4) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:19:08 user nova-compute[74903]: INFO os_vif [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:99:ed,bridge_name='br-int',has_traffic_filtering=True,id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2def6f-42')
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Deleting instance files /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516_del
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Deletion of /opt/stack/data/nova/instances/cf488c8c-d9d5-4349-b00b-306c7bddc516_del complete
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.compute.manager [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 06:19:08 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Took 0.75 seconds to deallocate network for instance.
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-7c4520f6-a335-4c98-a8ce-4ec3319da391 req-d1883d90-30b0-48be-ac51-75aed08d87a4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-deleted-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:08 user nova-compute[74903]: INFO nova.compute.manager [req-7c4520f6-a335-4c98-a8ce-4ec3319da391 req-d1883d90-30b0-48be-ac51-75aed08d87a4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Neutron deleted interface 7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5; detaching it from the instance and deleting it from the info cache
Nov 06 06:19:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-7c4520f6-a335-4c98-a8ce-4ec3319da391 req-d1883d90-30b0-48be-ac51-75aed08d87a4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-7c4520f6-a335-4c98-a8ce-4ec3319da391 req-d1883d90-30b0-48be-ac51-75aed08d87a4 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Detach interface failed, port_id=7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5, reason: Instance cf488c8c-d9d5-4349-b00b-306c7bddc516 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:09 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Deleted allocations for instance cf488c8c-d9d5-4349-b00b-306c7bddc516
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d632ebab-72b6-4cbc-90d1-e710f6749805 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:19:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Creating image(s)
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Ensure instance console log exists: /opt/stack/data/nova/instances/1c59014f-48fa-438c-a5a0-8d7f2d117bd7/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Start _get_guest_xml network_info=[{"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIXcrTbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c59014f-48fa-438c-a5a0-8d7f2d117bd7', 'attached_at': '', 'detached_at': '', 'volume_id': '55accf0e-b2ca-4852-8e2f-362591c899bd', 'serial': '55accf0e-b2ca-4852-8e2f-362591c899bd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '9c522f32-d611-4933-8d36-264c07c449ec', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:19:09 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:19:09 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIXcrTbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:19:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:19:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:19:09 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] Acquiring lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] Lock "cf488c8c-d9d5-4349-b00b-306c7bddc516-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] No waiting events found dispatching network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:09 user nova-compute[74903]: WARNING nova.compute.manager [req-d5637377-fbd9-4285-8d7e-35dde64854b5 req-7dd71485-a01b-44d5-bb36-3fc019dc4826 service nova] [instance: cf488c8c-d9d5-4349-b00b-306c7bddc516] Received unexpected event network-vif-plugged-7e2def6f-42f4-40b4-bbbe-fbe1b83f8fa5 for instance with vm_state deleted and task_state None.
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc643a17-11a4-4b3d-9496-4316d61f4055]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:19:09 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b08fcd0-1d26-49ba-a8e4-c225c7b1e146]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd] added
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fa924-0f5d-413d-9aa3-46089af03096]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1813c7-6204-4884-8368-4ab2d80dbb9b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIXcrTbS {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HIXcrTbS" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de1039-c65c-48e1-acba-a634c00cd7a6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HIXcrTbS'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fdfac-e63f-4aae-a242-ce3bf45a3dea]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9e8ce4-80bd-424a-9c9c-27068b69e671]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6307215-60e0-4608-b96e-57d55311342c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260]
Nov 06 06:19:09 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260] successful.
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d14eda7-71c2-490f-9d68-e953b849b6f5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b118e72-b2de-495d-a3e9-d21c40c945af]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:09 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:09 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:19:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[76854a1c-8ee5-4dfa-b379-a50aac1b7fea]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:19:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIXcrTbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23062323432373063', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062323432373063', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47378027',display_name='tempest-TestVolumeBootPattern-server-47378027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47378027',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-azd6bmbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:18:41Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=1c59014f-48fa-438c-a5a0-8d7f2d117bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.objects.instance [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c59014f-48fa-438c-a5a0-8d7f2d117bd7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:19:11 user nova-compute[74903]:   <uuid>1c59014f-48fa-438c-a5a0-8d7f2d117bd7</uuid>
Nov 06 06:19:11 user nova-compute[74903]:   <name>instance-00000025</name>
Nov 06 06:19:11 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:19:11 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:19:11 user nova-compute[74903]:   <metadata>
Nov 06 06:19:11 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:19:11 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:19:11 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-server-47378027</nova:name>
Nov 06 06:19:11 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:19:09</nova:creationTime>
Nov 06 06:19:11 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:19:11 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:19:11 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:19:11 user nova-compute[74903]:       <nova:owner>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:19:11 user nova-compute[74903]:       </nova:owner>
Nov 06 06:19:11 user nova-compute[74903]:       <nova:ports>
Nov 06 06:19:11 user nova-compute[74903]:         <nova:port uuid="40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4">
Nov 06 06:19:11 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 06:19:11 user nova-compute[74903]:         </nova:port>
Nov 06 06:19:11 user nova-compute[74903]:       </nova:ports>
Nov 06 06:19:11 user nova-compute[74903]:     </nova:instance>
Nov 06 06:19:11 user nova-compute[74903]:   </metadata>
Nov 06 06:19:11 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:19:11 user nova-compute[74903]:     <system>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="serial">1c59014f-48fa-438c-a5a0-8d7f2d117bd7</entry>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="uuid">1c59014f-48fa-438c-a5a0-8d7f2d117bd7</entry>
Nov 06 06:19:11 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:19:11 user nova-compute[74903]:     </system>
Nov 06 06:19:11 user nova-compute[74903]:   </sysinfo>
Nov 06 06:19:11 user nova-compute[74903]:   <os>
Nov 06 06:19:11 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:19:11 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:19:11 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:19:11 user nova-compute[74903]:   </os>
Nov 06 06:19:11 user nova-compute[74903]:   <features>
Nov 06 06:19:11 user nova-compute[74903]:     <acpi/>
Nov 06 06:19:11 user nova-compute[74903]:     <apic/>
Nov 06 06:19:11 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:19:11 user nova-compute[74903]:   </features>
Nov 06 06:19:11 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:19:11 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:19:11 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:19:11 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:19:11 user nova-compute[74903]:   </clock>
Nov 06 06:19:11 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:19:11 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:19:11 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:19:11 user nova-compute[74903]:   </cpu>
Nov 06 06:19:11 user nova-compute[74903]:   <devices>
Nov 06 06:19:11 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:19:11 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:19:11 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:19:11 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:19:11 user nova-compute[74903]:       <serial>55accf0e-b2ca-4852-8e2f-362591c899bd</serial>
Nov 06 06:19:11 user nova-compute[74903]:     </disk>
Nov 06 06:19:11 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:19:11 user nova-compute[74903]:       <mac address="fa:16:3e:6f:19:2d"/>
Nov 06 06:19:11 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:19:11 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:19:11 user nova-compute[74903]:       <target dev="tap40b30e8e-cf"/>
Nov 06 06:19:11 user nova-compute[74903]:     </interface>
Nov 06 06:19:11 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:19:11 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/1c59014f-48fa-438c-a5a0-8d7f2d117bd7/console.log" append="off"/>
Nov 06 06:19:11 user nova-compute[74903]:     </serial>
Nov 06 06:19:11 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:19:11 user nova-compute[74903]:     <video>
Nov 06 06:19:11 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:19:11 user nova-compute[74903]:     </video>
Nov 06 06:19:11 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:19:11 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:19:11 user nova-compute[74903]:     </rng>
Nov 06 06:19:11 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:19:11 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:19:11 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:19:11 user nova-compute[74903]:     </memballoon>
Nov 06 06:19:11 user nova-compute[74903]:   </devices>
Nov 06 06:19:11 user nova-compute[74903]: </domain>
Nov 06 06:19:11 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47378027',display_name='tempest-TestVolumeBootPattern-server-47378027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47378027',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-azd6bmbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:18:41Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=1c59014f-48fa-438c-a5a0-8d7f2d117bd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG os_vif [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eb7440b-f0cc-59a1-8049-81ca426c8081', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40b30e8e-cf, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40b30e8e-cf, col_values=(('qos', UUID('0e34e3d3-a718-4419-9470-9c68e709063c')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40b30e8e-cf, col_values=(('external_ids', {'iface-id': '40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:19:2d', 'vm-uuid': '1c59014f-48fa-438c-a5a0-8d7f2d117bd7'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:11 user nova-compute[74903]: INFO os_vif [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf')
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:19:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:6f:19:2d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] No waiting events found dispatching network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:12 user nova-compute[74903]: WARNING nova.compute.manager [req-231b060d-f25c-448c-ad6c-989b89a4ea25 req-0df88091-2794-4869-ad92-b8c715319311 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received unexpected event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 for instance with vm_state building and task_state spawning.
Nov 06 06:19:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:19:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Instance spawned successfully.
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] No waiting events found dispatching network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:14 user nova-compute[74903]: WARNING nova.compute.manager [req-d4e9b397-5b0f-4788-bb18-2b3a21f39b64 req-1303ec73-4b9b-46f8-abd0-e002b5e2b97d service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received unexpected event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 for instance with vm_state building and task_state spawning.
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:19:14 user nova-compute[74903]: INFO nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 06 06:19:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:19:15 user nova-compute[74903]: INFO nova.compute.manager [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Took 34.45 seconds to build instance.
Nov 06 06:19:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-19e27142-4901-4520-8e10-c29183cf4f5b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.552s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [{"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-f57a3014-91be-48b7-8aa4-f18b3d29c93d" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:19:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:19:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-changed-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Refreshing instance network info cache due to event network-changed-f6531ffa-c360-4977-94ba-25ccf8e2474e. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Refreshing network info cache for port f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updated VIF entry in instance network info cache for port f6531ffa-c360-4977-94ba-25ccf8e2474e. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:19:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-13287695-4317-4a60-8eaf-0110cbfb8b51 req-d16bd3a5-efe6-4ab8-bdf2-226891f6f938 service nova] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:19:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:32 user nova-compute[74903]: INFO nova.compute.manager [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Attaching volume a4b7c253-eab4-498a-bd8d-9f9cd43089ec to /dev/vdb
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.utils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[673afc43-7aeb-4c16-b289-63de9806e498]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd5fa4-a8f6-4d3a-9d8d-097ef6c7fe02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b90099-89d2-4248-b442-3574702df6f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36101c9-ec70-4173-9563-56e3684c9b34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:19:32 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[78464bfa-c075-4b7d-a3fe-1081814b6b10]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG os_brick.utils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating existing volume attachment record: ce77e3cb-c3fa-4c06-be32-7df5a85976db {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:19:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:19:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=25.279903411865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 1c59014f-48fa-438c-a5a0-8d7f2d117bd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:19:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:19:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:19:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:19:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:19:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:19:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:19:55 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:19:55 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:19:55 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b824e8-97e5-4f92-bef2-115a57d08022]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:19:55 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efbed44-b38d-47b0-8884-d8537ed47a1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec] added
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.129s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6bd3c3-a153-4ae4-a2f2-86eeb6265b91]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba78b5d-68be-4226-825e-36cdc02d9031]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FepdruXh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FepdruXh" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088326f-4cfd-4755-bfde-dbf36e9d0520]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FepdruXh'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bfa5c9-0677-4761-9ef2-3c57a36e9ca6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7dd49-d459-4bda-ad3e-318c741159b1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9017ba-ad5e-4f17-998d-15f83389bd87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]
Nov 06 06:19:55 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039ca36-b52e-4592-9bb9-37484f24f04d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[89004b8e-cd82-4b31-ba5c-5e6797bc5129]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:19:55 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:19:55 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c6460-509a-4c8c-af6c-81453c1db33c]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:19:55 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23963396335636566', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396335636566', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG nova.objects.instance [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:56 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:19:56 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:19:56 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:19:56 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:19:56 user nova-compute[74903]:   <serial>a4b7c253-eab4-498a-bd8d-9f9cd43089ec</serial>
Nov 06 06:19:56 user nova-compute[74903]: </disk>
Nov 06 06:19:56 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:19:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:19:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:19:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No VIF found with MAC fa:16:3e:58:e8:a8, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:19:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2509e978-557e-458b-99e7-c4b716e11fe8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.645s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG nova.compute.manager [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74903) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG nova.objects.instance [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:19:58 user nova-compute[74903]: WARNING nova.compute.manager [req-fad93ceb-16dd-4366-893e-08f79634f809 req-8edc0201-7e4c-401a-8d6b-7dc77fcca6d7 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state active and task_state powering-off.
Nov 06 06:19:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:19:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:19:59 user nova-compute[74903]: INFO nova.compute.manager [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Detaching volume cf4181f8-edec-4077-a118-d6017d611000
Nov 06 06:19:59 user nova-compute[74903]: INFO nova.virt.block_device [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Attempting to driver detach volume cf4181f8-edec-4077-a118-d6017d611000 from mountpoint /dev/vdb
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Attempting to detach device vdb from instance f57a3014-91be-48b7-8aa4-f18b3d29c93d from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:19:59 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:19:59 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:19:59 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:19:59 user nova-compute[74903]:   <serial>cf4181f8-edec-4077-a118-d6017d611000</serial>
Nov 06 06:19:59 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:19:59 user nova-compute[74903]: </disk>
Nov 06 06:19:59 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:19:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance f57a3014-91be-48b7-8aa4-f18b3d29c93d from the persistent domain config.
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f57a3014-91be-48b7-8aa4-f18b3d29c93d from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:19:59 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:19:59 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:19:59 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:19:59 user nova-compute[74903]:   <serial>cf4181f8-edec-4077-a118-d6017d611000</serial>
Nov 06 06:19:59 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:19:59 user nova-compute[74903]: </disk>
Nov 06 06:19:59 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:19:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance destroyed successfully.
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:19:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-dd188e71-3bc1-4b01-a66a-4bdf22ae1562 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.883s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:19:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:20:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:00 user nova-compute[74903]: DEBUG nova.compute.manager [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:20:00 user nova-compute[74903]: WARNING nova.compute.manager [req-b429187d-818f-4b59-9006-bea3ba3ce96a req-a8dbe936-67e0-4df9-8ad6-f3d327d0402b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state None.
Nov 06 06:20:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:19 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f57a3014-91be-48b7-8aa4-f18b3d29c93d is timed out.
Nov 06 06:20:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance f57a3014-91be-48b7-8aa4-f18b3d29c93d from the live domain config.
Nov 06 06:20:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDvxegaR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:20:19 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c702695-aff6-4ebd-9194-82ad701167a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:20:19 user nova-compute[74903]: No targets found.
Nov 06 06:20:19 user nova-compute[74903]: iSNS:
Nov 06 06:20:19 user nova-compute[74903]: No targets found.
Nov 06 06:20:19 user nova-compute[74903]: STATIC:
Nov 06 06:20:19 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd
Nov 06 06:20:19 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:20:19 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:20:19 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000
Nov 06 06:20:19 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:20:19 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:20:19 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec
Nov 06 06:20:19 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:20:19 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:20:19 user nova-compute[74903]: FIRMWARE:
Nov 06 06:20:19 user nova-compute[74903]: No targets found.
Nov 06 06:20:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:20:19 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:20:19 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e453c-0c6a-4b48-a4b2-bc6f483a3c8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e109f47-5067-42b3-ac34-40a3d92f3c9f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:20:19 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:20:19 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:20:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 (non-flash)
Nov 06 06:20:19 user nova-compute[74903]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:20:19 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:20:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085b4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[badbc73c-a378-4c07-ae32-bb8b423e0bbc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfc414d-6109-45c1-8e78-1d112de5cb1d]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1b8fe-6129-4f63-8c36-534fee0de2ee]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f6970-3033-406a-8374-cffd47a26c1b]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8bd49-7343-42ff-bc11-50867e6e04c1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5777f59a-daca-45d4-a6bc-5bc5c4c33595]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260]
Nov 06 06:20:19 user nova-compute[74903]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000, portal: 172.16.0.220,3260] successful.
Nov 06 06:20:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf4181f8-edec-4077-a118-d6017d611000 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2177e990-ef07-4934-bf67-c961be0a3ee5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== disconnect_volume: return (289ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:20:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6630d6ac-74d5-4ca9-99de-1d5d6b4927c9 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.998s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:20:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:20:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:20:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:31 user nova-compute[74903]: INFO nova.compute.manager [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Terminating instance
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-unplugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] No waiting events found dispatching network-vif-unplugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-10c173bc-faa3-457f-a1f1-4ab2de5e0af7 req-c7ca3632-1c5a-4874-9498-fa6bf8002b8b service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-unplugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:20:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Instance destroyed successfully.
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid 1c59014f-48fa-438c-a5a0-8d7f2d117bd7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-47378027',display_name='tempest-TestVolumeBootPattern-server-47378027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-47378027',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:19:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-azd6bmbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:19:15Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=1c59014f-48fa-438c-a5a0-8d7f2d117bd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "address": "fa:16:3e:6f:19:2d", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40b30e8e-cf", "ovs_interfaceid": "40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG os_vif [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40b30e8e-cf, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e34e3d3-a718-4419-9470-9c68e709063c) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:31 user nova-compute[74903]: INFO os_vif [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:19:2d,bridge_name='br-int',has_traffic_filtering=True,id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40b30e8e-cf')
Nov 06 06:20:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HIXcrTbS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:20:31 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:20:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6439a155-541e-43bd-9857-aa37bb3dff86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:20:31 user nova-compute[74903]: No targets found.
Nov 06 06:20:31 user nova-compute[74903]: iSNS:
Nov 06 06:20:31 user nova-compute[74903]: No targets found.
Nov 06 06:20:31 user nova-compute[74903]: STATIC:
Nov 06 06:20:31 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd
Nov 06 06:20:31 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:20:31 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:20:31 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec
Nov 06 06:20:31 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:20:31 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:20:31 user nova-compute[74903]: FIRMWARE:
Nov 06 06:20:31 user nova-compute[74903]: No targets found.
Nov 06 06:20:31 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:20:32 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:20:32 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4fcc81-02cb-4eff-984a-356f24bc5c59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba60db1-b0fa-42a2-b7d6-98960202c4f6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:20:32 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:20:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd (non-flash)
Nov 06 06:20:32 user nova-compute[74903]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:20:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4028d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1c6e20-af05-4e61-a8eb-66346e77d881]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839c668-9f72-40eb-90e7-d8e32021c2cc]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6448c6a5-ac06-4cbb-831f-646b392ce2bd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.087s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d04667-cda8-4483-a0b8-470e34830fba]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.081s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb7dc2-b995-41ef-a8b4-9fcb15375aa8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[96378f1f-7cd7-42ea-bff9-0bdeac398b84]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260]
Nov 06 06:20:32 user nova-compute[74903]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd, portal: 172.16.0.220,3260] successful.
Nov 06 06:20:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55accf0e-b2ca-4852-8e2f-362591c899bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[078342a5-57be-4aca-9163-33b699577d7b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (458ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:20:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Deleting instance files /opt/stack/data/nova/instances/1c59014f-48fa-438c-a5a0-8d7f2d117bd7_del
Nov 06 06:20:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Deletion of /opt/stack/data/nova/instances/1c59014f-48fa-438c-a5a0-8d7f2d117bd7_del complete
Nov 06 06:20:32 user nova-compute[74903]: INFO nova.compute.manager [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 06 06:20:32 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:20:32 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:20:33 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Took 0.51 seconds to deallocate network for instance.
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-9431840e-2161-404d-ba60-7e262ab9c3f4 req-2b2567fb-2e83-4dcc-86e8-f3e098cd9b21 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-deleted-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:33 user nova-compute[74903]: INFO nova.compute.manager [req-9431840e-2161-404d-ba60-7e262ab9c3f4 req-2b2567fb-2e83-4dcc-86e8-f3e098cd9b21 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Neutron deleted interface 40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4; detaching it from the instance and deleting it from the info cache
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-9431840e-2161-404d-ba60-7e262ab9c3f4 req-2b2567fb-2e83-4dcc-86e8-f3e098cd9b21 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-9431840e-2161-404d-ba60-7e262ab9c3f4 req-2b2567fb-2e83-4dcc-86e8-f3e098cd9b21 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Detach interface failed, port_id=40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4, reason: Instance 1c59014f-48fa-438c-a5a0-8d7f2d117bd7 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] Acquiring lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] No waiting events found dispatching network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:20:33 user nova-compute[74903]: WARNING nova.compute.manager [req-55bdef6e-7f37-4628-b41b-89bc76f301a9 req-a9ac454f-b6c8-44c1-a110-55baf140ddf4 service nova] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Received unexpected event network-vif-plugged-40b30e8e-cf4d-4aa0-870f-f0b7c85b3dc4 for instance with vm_state active and task_state deleting.
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:34 user nova-compute[74903]: INFO nova.compute.manager [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Took 1.02 seconds to detach 1 volumes for instance.
Nov 06 06:20:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 1c59014f-48fa-438c-a5a0-8d7f2d117bd7] Deleting volume: 55accf0e-b2ca-4852-8e2f-362591c899bd {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:34 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance 1c59014f-48fa-438c-a5a0-8d7f2d117bd7
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1061b01-a628-49f1-8a42-e3b9a80dcfd3 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "1c59014f-48fa-438c-a5a0-8d7f2d117bd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.818s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:20:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:20:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.26883316040039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance f57a3014-91be-48b7-8aa4-f18b3d29c93d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:20:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:20:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing instance network info cache due to event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:20:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:47 user nova-compute[74903]: DEBUG nova.network.neutron [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated VIF entry in instance network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:20:47 user nova-compute[74903]: DEBUG nova.network.neutron [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:20:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a56093a7-096a-4e5f-935a-603eeb1e9a96 req-6a549654-bac9-4e31-b502-8e23c86a79b3 service nova] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:20:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:20:47 user nova-compute[74903]: INFO nova.compute.manager [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] instance snapshotting
Nov 06 06:20:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Beginning live snapshot process
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc.delta 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc.delta 1073741824" returned: 0 in 0.049s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:49 user nova-compute[74903]: INFO nova.compute.manager [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Terminating instance
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-unplugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] No waiting events found dispatching network-vif-unplugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-d602e07e-c71b-4a36-8661-9c4b5fa6579c req-337deb14-5cef-441e-b4ec-228c8b7ab7af service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-unplugged-5461551d-7d52-4759-a4ec-3d8942f088a8 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:20:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:20:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 06:20:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Instance destroyed successfully.
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'resources' on Instance uuid f57a3014-91be-48b7-8aa4-f18b3d29c93d {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc.delta /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-54089458',display_name='tempest-AttachVolumeNegativeTest-server-54089458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-54089458',id=34,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzMsWPVR5/zqcYkbRVd7CPaAnLNZoXlCTzW9ozcqwd1/dLtFV1LnGexo8v2aYBOjkjqVpNb6QRKPq2/MnGe1mKXz+3hINvSgVwCDCY7FZa54UXoR0/unm2SjIJWRb1xGw==',key_name='tempest-keypair-1573669941',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-ihiq96mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:14:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=f57a3014-91be-48b7-8aa4-f18b3d29c93d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "5461551d-7d52-4759-a4ec-3d8942f088a8", "address": "fa:16:3e:7b:3a:14", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5461551d-7d", "ovs_interfaceid": "5461551d-7d52-4759-a4ec-3d8942f088a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG os_vif [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5461551d-7d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5f5e1d8-5c57-45de-982c-13845e347e7d) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:50 user nova-compute[74903]: INFO os_vif [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:3a:14,bridge_name='br-int',has_traffic_filtering=True,id=5461551d-7d52-4759-a4ec-3d8942f088a8,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5461551d-7d')
Nov 06 06:20:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Deleting instance files /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d_del
Nov 06 06:20:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Deletion of /opt/stack/data/nova/instances/f57a3014-91be-48b7-8aa4-f18b3d29c93d_del complete
Nov 06 06:20:50 user nova-compute[74903]: INFO nova.compute.manager [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 06 06:20:50 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:20:50 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:20:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc.delta /opt/stack/data/nova/instances/snapshots/tmp6m1g06uc/55d71a455f1749e584dfc01d6d1f90fc" returned: 0 in 0.593s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:20:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Snapshot extracted, beginning image upload
Nov 06 06:20:51 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:20:51 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Took 1.22 seconds to deallocate network for instance.
Nov 06 06:20:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] Acquiring lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] No waiting events found dispatching network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:20:52 user nova-compute[74903]: WARNING nova.compute.manager [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received unexpected event network-vif-plugged-5461551d-7d52-4759-a4ec-3d8942f088a8 for instance with vm_state deleted and task_state None.
Nov 06 06:20:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b007d63-362c-4096-b14e-71ea28ff0dd0 req-4c2f411c-6b61-4dc1-a4f4-2136b1aadbcc service nova] [instance: f57a3014-91be-48b7-8aa4-f18b3d29c93d] Received event network-vif-deleted-5461551d-7d52-4759-a4ec-3d8942f088a8 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:52 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Deleted allocations for instance f57a3014-91be-48b7-8aa4-f18b3d29c93d
Nov 06 06:20:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5ea661ae-125d-4f14-bac8-121d926c9f5e tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "f57a3014-91be-48b7-8aa4-f18b3d29c93d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.815s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:20:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Snapshot image upload complete
Nov 06 06:20:53 user nova-compute[74903]: INFO nova.compute.manager [None req-9841e9d9-5b4f-4a97-a434-9d254f93fa82 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Took 5.95 seconds to snapshot the instance on the hypervisor.
Nov 06 06:20:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:20:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:21:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:11 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:21:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:21:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:21:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:34 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.235618591308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bffa2829-0129-4874-b8a0-414651356cb8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:21:34 user nova-compute[74903]: INFO nova.compute.claims [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Claim successful on node user
Nov 06 06:21:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:21:35 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.policy [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f68278436c824503a2c737b8ded10bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcdaeed567b049d4b154ad34788b564c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:21:35 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Creating image(s)
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "/opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "/opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "/opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk 1073741824" returned: 0 in 0.053s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Successfully created port: 259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:21:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Cannot resize image /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Ensure instance console log exists: /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Successfully updated port: 259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquired lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-changed-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Refreshing instance network info cache due to event network-changed-259a970a-b92b-4eb1-82a7-27d2377a65c2. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] Acquiring lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating instance_info_cache with network_info: [{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Releasing lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Instance network_info: |[{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] Acquired lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Refreshing network info cache for port 259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Start _get_guest_xml network_info=[{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:21:36 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:36 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-844307720',display_name='tempest-TestServerVolumeAttachmentScenario-server-844307720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-844307720',id=39,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwpAN9pLM+Af2MKo6PCnr75OlsCsUjEztWzNEEBhDz1eo2jbx0/59Nm0V1IMj7MTL4T66fTXo1ELpOpxFz7HJR1548A5gv5WQeT1ZAj5zUj08DPasWOhA7A3ya1gdB0JA==',key_name='tempest-keypair-535462748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcdaeed567b049d4b154ad34788b564c',ramdisk_id='',reservation_id='r-4p76hug2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1695730784',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1695730784-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68278436c824503a2c737b8ded10bc8',uuid=bffa2829-0129-4874-b8a0-414651356cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:21:36 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converting VIF {"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'pci_devices' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:21:37 user nova-compute[74903]:   <uuid>bffa2829-0129-4874-b8a0-414651356cb8</uuid>
Nov 06 06:21:37 user nova-compute[74903]:   <name>instance-00000027</name>
Nov 06 06:21:37 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:21:37 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:21:37 user nova-compute[74903]:   <metadata>
Nov 06 06:21:37 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:21:37 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-844307720</nova:name>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:21:36</nova:creationTime>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:21:37 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:21:37 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:owner>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:user uuid="f68278436c824503a2c737b8ded10bc8">tempest-TestServerVolumeAttachmentScenario-1695730784-project-member</nova:user>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:project uuid="fcdaeed567b049d4b154ad34788b564c">tempest-TestServerVolumeAttachmentScenario-1695730784</nova:project>
Nov 06 06:21:37 user nova-compute[74903]:       </nova:owner>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:21:37 user nova-compute[74903]:       <nova:ports>
Nov 06 06:21:37 user nova-compute[74903]:         <nova:port uuid="259a970a-b92b-4eb1-82a7-27d2377a65c2">
Nov 06 06:21:37 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:21:37 user nova-compute[74903]:         </nova:port>
Nov 06 06:21:37 user nova-compute[74903]:       </nova:ports>
Nov 06 06:21:37 user nova-compute[74903]:     </nova:instance>
Nov 06 06:21:37 user nova-compute[74903]:   </metadata>
Nov 06 06:21:37 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:21:37 user nova-compute[74903]:     <system>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="serial">bffa2829-0129-4874-b8a0-414651356cb8</entry>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="uuid">bffa2829-0129-4874-b8a0-414651356cb8</entry>
Nov 06 06:21:37 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:21:37 user nova-compute[74903]:     </system>
Nov 06 06:21:37 user nova-compute[74903]:   </sysinfo>
Nov 06 06:21:37 user nova-compute[74903]:   <os>
Nov 06 06:21:37 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:21:37 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:21:37 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:21:37 user nova-compute[74903]:   </os>
Nov 06 06:21:37 user nova-compute[74903]:   <features>
Nov 06 06:21:37 user nova-compute[74903]:     <acpi/>
Nov 06 06:21:37 user nova-compute[74903]:     <apic/>
Nov 06 06:21:37 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:21:37 user nova-compute[74903]:   </features>
Nov 06 06:21:37 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:21:37 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:21:37 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:21:37 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:21:37 user nova-compute[74903]:   </clock>
Nov 06 06:21:37 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:21:37 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:21:37 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:21:37 user nova-compute[74903]:   </cpu>
Nov 06 06:21:37 user nova-compute[74903]:   <devices>
Nov 06 06:21:37 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:21:37 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:21:37 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk"/>
Nov 06 06:21:37 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:21:37 user nova-compute[74903]:     </disk>
Nov 06 06:21:37 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:21:37 user nova-compute[74903]:       <mac address="fa:16:3e:6e:1c:04"/>
Nov 06 06:21:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:37 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:21:37 user nova-compute[74903]:       <target dev="tap259a970a-b9"/>
Nov 06 06:21:37 user nova-compute[74903]:     </interface>
Nov 06 06:21:37 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:21:37 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/console.log" append="off"/>
Nov 06 06:21:37 user nova-compute[74903]:     </serial>
Nov 06 06:21:37 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:21:37 user nova-compute[74903]:     <video>
Nov 06 06:21:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:37 user nova-compute[74903]:     </video>
Nov 06 06:21:37 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:21:37 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:21:37 user nova-compute[74903]:     </rng>
Nov 06 06:21:37 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:21:37 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:21:37 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:21:37 user nova-compute[74903]:     </memballoon>
Nov 06 06:21:37 user nova-compute[74903]:   </devices>
Nov 06 06:21:37 user nova-compute[74903]: </domain>
Nov 06 06:21:37 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-844307720',display_name='tempest-TestServerVolumeAttachmentScenario-server-844307720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-844307720',id=39,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwpAN9pLM+Af2MKo6PCnr75OlsCsUjEztWzNEEBhDz1eo2jbx0/59Nm0V1IMj7MTL4T66fTXo1ELpOpxFz7HJR1548A5gv5WQeT1ZAj5zUj08DPasWOhA7A3ya1gdB0JA==',key_name='tempest-keypair-535462748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcdaeed567b049d4b154ad34788b564c',ramdisk_id='',reservation_id='r-4p76hug2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1695730784',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1695730784-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:21:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68278436c824503a2c737b8ded10bc8',uuid=bffa2829-0129-4874-b8a0-414651356cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converting VIF {"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG os_vif [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3201a623-1f38-5339-8df1-c885e9da4bb4', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap259a970a-b9, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap259a970a-b9, col_values=(('qos', UUID('5390407a-321d-4788-bb5c-6caac3a2b858')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap259a970a-b9, col_values=(('external_ids', {'iface-id': '259a970a-b92b-4eb1-82a7-27d2377a65c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1c:04', 'vm-uuid': 'bffa2829-0129-4874-b8a0-414651356cb8'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:37 user nova-compute[74903]: INFO os_vif [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9')
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No VIF found with MAC fa:16:3e:6e:1c:04, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updated VIF entry in instance network info cache for port 259a970a-b92b-4eb1-82a7-27d2377a65c2. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating instance_info_cache with network_info: [{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-98ed05c8-8df7-460d-94aa-999aa4353771 req-97a97492-6824-4b27-a2aa-61c0138246ef service nova] Releasing lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] No waiting events found dispatching network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:38 user nova-compute[74903]: WARNING nova.compute.manager [req-da7063e7-028e-4079-9348-ec4b808eb386 req-28763402-f1b9-4bde-bb8e-59b0ba2f1623 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received unexpected event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 for instance with vm_state building and task_state spawning.
Nov 06 06:21:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:21:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Instance spawned successfully.
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] No waiting events found dispatching network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:40 user nova-compute[74903]: WARNING nova.compute.manager [req-6eb5fdc0-54c8-475f-9c82-7e2c62c03885 req-3fd3cb49-4093-47e2-a044-054852035838 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received unexpected event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 for instance with vm_state building and task_state spawning.
Nov 06 06:21:40 user nova-compute[74903]: INFO nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 06 06:21:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:21:40 user nova-compute[74903]: INFO nova.compute.manager [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Took 6.19 seconds to build instance.
Nov 06 06:21:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-b081a2f5-f080-409c-829a-b64f1fb9db75 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.301s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:21:43 user nova-compute[74903]: INFO nova.compute.claims [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Claim successful on node user
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:21:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.policy [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8673337612a54ca0a89d180a830cbaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ac2801ad3f4b75bc98d85071d479c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:21:43 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Creating image(s)
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "/opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.328s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Successfully created port: 2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk 1073741824" returned: 0 in 0.090s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.427s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.238s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:21:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Cannot resize image /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Successfully updated port: 2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquired lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-changed-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.compute.manager [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Refreshing instance network info cache due to event network-changed-2c405138-3e8e-4db3-afb3-06c8cd1122de. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] Acquiring lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updating instance_info_cache with network_info: [{"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Releasing lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Instance network_info: |[{"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] Acquired lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.neutron [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Refreshing network info cache for port 2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Start _get_guest_xml network_info=[{"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:21:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1720233683',display_name='tempest-AttachVolumeNegativeTest-server-1720233683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1720233683',id=40,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz4ZZ9GL87vW4s9yLR9wMAOMpv+oPltfFbGFENoXMXH2Oe2rT1XN9WrFqPqCrUiU1jdsTznmZLr9BImSGSiKhylPX16uUeTg9uCvxZGm5A+AJypj88EyoQj3LbUVFr9gQ==',key_name='tempest-keypair-1041408340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-4itcx9d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=e81183fa-470e-494d-9e07-c216b9a08e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'pci_devices' on Instance uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:21:45 user nova-compute[74903]:   <uuid>e81183fa-470e-494d-9e07-c216b9a08e6f</uuid>
Nov 06 06:21:45 user nova-compute[74903]:   <name>instance-00000028</name>
Nov 06 06:21:45 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:21:45 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:21:45 user nova-compute[74903]:   <metadata>
Nov 06 06:21:45 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:21:45 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1720233683</nova:name>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:21:45</nova:creationTime>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:21:45 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:21:45 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:owner>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:user uuid="8673337612a54ca0a89d180a830cbaf5">tempest-AttachVolumeNegativeTest-1944196622-project-member</nova:user>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:project uuid="b9ac2801ad3f4b75bc98d85071d479c6">tempest-AttachVolumeNegativeTest-1944196622</nova:project>
Nov 06 06:21:45 user nova-compute[74903]:       </nova:owner>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:21:45 user nova-compute[74903]:       <nova:ports>
Nov 06 06:21:45 user nova-compute[74903]:         <nova:port uuid="2c405138-3e8e-4db3-afb3-06c8cd1122de">
Nov 06 06:21:45 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 06:21:45 user nova-compute[74903]:         </nova:port>
Nov 06 06:21:45 user nova-compute[74903]:       </nova:ports>
Nov 06 06:21:45 user nova-compute[74903]:     </nova:instance>
Nov 06 06:21:45 user nova-compute[74903]:   </metadata>
Nov 06 06:21:45 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:21:45 user nova-compute[74903]:     <system>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="serial">e81183fa-470e-494d-9e07-c216b9a08e6f</entry>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="uuid">e81183fa-470e-494d-9e07-c216b9a08e6f</entry>
Nov 06 06:21:45 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:21:45 user nova-compute[74903]:     </system>
Nov 06 06:21:45 user nova-compute[74903]:   </sysinfo>
Nov 06 06:21:45 user nova-compute[74903]:   <os>
Nov 06 06:21:45 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:21:45 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:21:45 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:21:45 user nova-compute[74903]:   </os>
Nov 06 06:21:45 user nova-compute[74903]:   <features>
Nov 06 06:21:45 user nova-compute[74903]:     <acpi/>
Nov 06 06:21:45 user nova-compute[74903]:     <apic/>
Nov 06 06:21:45 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:21:45 user nova-compute[74903]:   </features>
Nov 06 06:21:45 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:21:45 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:21:45 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:21:45 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:21:45 user nova-compute[74903]:   </clock>
Nov 06 06:21:45 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:21:45 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:21:45 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:21:45 user nova-compute[74903]:   </cpu>
Nov 06 06:21:45 user nova-compute[74903]:   <devices>
Nov 06 06:21:45 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:21:45 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:21:45 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk"/>
Nov 06 06:21:45 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:21:45 user nova-compute[74903]:     </disk>
Nov 06 06:21:45 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:21:45 user nova-compute[74903]:       <mac address="fa:16:3e:b5:9d:b8"/>
Nov 06 06:21:45 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:45 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:21:45 user nova-compute[74903]:       <target dev="tap2c405138-3e"/>
Nov 06 06:21:45 user nova-compute[74903]:     </interface>
Nov 06 06:21:45 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:21:45 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/console.log" append="off"/>
Nov 06 06:21:45 user nova-compute[74903]:     </serial>
Nov 06 06:21:45 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:21:45 user nova-compute[74903]:     <video>
Nov 06 06:21:45 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:45 user nova-compute[74903]:     </video>
Nov 06 06:21:45 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:21:45 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:21:45 user nova-compute[74903]:     </rng>
Nov 06 06:21:45 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:21:45 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:21:45 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:21:45 user nova-compute[74903]:     </memballoon>
Nov 06 06:21:45 user nova-compute[74903]:   </devices>
Nov 06 06:21:45 user nova-compute[74903]: </domain>
Nov 06 06:21:45 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1720233683',display_name='tempest-AttachVolumeNegativeTest-server-1720233683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1720233683',id=40,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz4ZZ9GL87vW4s9yLR9wMAOMpv+oPltfFbGFENoXMXH2Oe2rT1XN9WrFqPqCrUiU1jdsTznmZLr9BImSGSiKhylPX16uUeTg9uCvxZGm5A+AJypj88EyoQj3LbUVFr9gQ==',key_name='tempest-keypair-1041408340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-4itcx9d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=e81183fa-470e-494d-9e07-c216b9a08e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG os_vif [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28535032-7fec-5ff1-8feb-8e4a3ddc23c6', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c405138-3e, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c405138-3e, col_values=(('qos', UUID('058b746a-b117-424f-ab65-27b23362f182')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c405138-3e, col_values=(('external_ids', {'iface-id': '2c405138-3e8e-4db3-afb3-06c8cd1122de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:9d:b8', 'vm-uuid': 'e81183fa-470e-494d-9e07-c216b9a08e6f'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:45 user nova-compute[74903]: INFO os_vif [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e')
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:21:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:b5:9d:b8, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:21:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updated VIF entry in instance network info cache for port 2c405138-3e8e-4db3-afb3-06c8cd1122de. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:21:46 user nova-compute[74903]: DEBUG nova.network.neutron [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updating instance_info_cache with network_info: [{"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0620c069-4ef8-4dc0-8acb-b08a51e265e7 req-37b7a03f-2afd-495d-89f8-d20ca47dbaf9 service nova] Releasing lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] No waiting events found dispatching network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:47 user nova-compute[74903]: WARNING nova.compute.manager [req-d8009e78-26d2-4a7f-8afa-241b92c802ea req-5426670f-b805-4c88-8e0f-7f33317a08e5 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received unexpected event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de for instance with vm_state building and task_state spawning.
Nov 06 06:21:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:21:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:21:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'info_cache' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:21:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Instance spawned successfully.
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] No waiting events found dispatching network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:49 user nova-compute[74903]: WARNING nova.compute.manager [req-f2662ab4-354b-4b33-a221-a47c7fe97485 req-00ba216f-4fd8-4c67-88af-d4f2ce19b23d service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received unexpected event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de for instance with vm_state building and task_state spawning.
Nov 06 06:21:49 user nova-compute[74903]: INFO nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:21:49 user nova-compute[74903]: INFO nova.compute.manager [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Took 6.39 seconds to build instance.
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-85c57a73-023f-4db7-8c8b-4e5810e91ed5 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.513s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:21:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:21:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance destroyed successfully.
Nov 06 06:21:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'resources' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6531ffa-c3, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ec31771-3c7a-421a-b41b-600660ae6129) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:50 user nova-compute[74903]: INFO os_vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:21:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c5fd0f-f56e-444b-8f36-e8c9dafff228]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:21:50 user nova-compute[74903]: No targets found.
Nov 06 06:21:50 user nova-compute[74903]: iSNS:
Nov 06 06:21:50 user nova-compute[74903]: No targets found.
Nov 06 06:21:50 user nova-compute[74903]: STATIC:
Nov 06 06:21:50 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec
Nov 06 06:21:50 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:21:50 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:21:50 user nova-compute[74903]: FIRMWARE:
Nov 06 06:21:50 user nova-compute[74903]: No targets found.
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:21:50 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:21:50 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdb88a-a2c9-47e8-81ec-20b3a664c4d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16761b5-512f-44ba-9463-1c2262a3ec15]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085e2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd18cee-875e-444f-95a5-e157c2fb0783]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bd6e5-5023-4847-9c32-a8d15bb61238]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca70bb-069b-4d60-90e5-8009f020fea7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6572858a-7d08-4845-a4c9-84bd80ca8219]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901c44d-a480-470d-b56d-478323238148]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[743bdfe6-2983-42cf-8dce-a38e1df54e07]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]
Nov 06 06:21:50 user nova-compute[74903]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[276db628-7336-473b-9ddc-a99eed0378b7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== disconnect_volume: return (371ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start _get_guest_xml network_info=[{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8d8c3ba8-856b-4e95-800d-7d4b8ab946fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'serial': 'a4b7c253-eab4-498a-bd8d-9f9cd43089ec'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': 'ce77e3cb-c3fa-4c06-be32-7df5a85976db', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:21:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:21:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:21:50 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd5cf3-b840-4c6a-8cfb-002c60873720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:21:50 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0226bd-4560-4eb2-8dc5-467d3bbacc9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec] added
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea08801-6fe5-45e2-aa58-814f090d5c41]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb8fe0-0496-4c12-a25a-af26aa04db13]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FepdruXh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FepdruXh" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[116dd54c-c93e-4056-8523-515c2ee761d5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FepdruXh'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f014e-a887-4323-aab1-0dda1ea7576c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8b6c5f-e1e7-4944-80d6-33bc377ce1f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:21:50 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:21:50 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:21:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:21:50 user nova-compute[74903]: 
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29fc01d-5547-4dba-8622-463c93325b58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]
Nov 06 06:21:50 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[178d81b1-b92e-4369-af6d-dc5d7adb4704]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7120b32b-be5d-4837-ba09-93128c79e1b6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:21:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f43c94-61d9-4415-bc69-0d931d0f2024]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:21:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23963396335636566', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396335636566', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:21:51 user nova-compute[74903]:   <uuid>8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</uuid>
Nov 06 06:21:51 user nova-compute[74903]:   <name>instance-00000024</name>
Nov 06 06:21:51 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:21:51 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:21:51 user nova-compute[74903]:   <metadata>
Nov 06 06:21:51 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:21:51 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeTestJSON-server-534899196</nova:name>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:21:50</nova:creationTime>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:21:51 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:21:51 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:owner>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:user uuid="bd5ebd68316d430a86749b05b13ebf21">tempest-AttachVolumeTestJSON-2127223018-project-member</nova:user>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:project uuid="5f0ee9f9d310436fb18fb51fe1c2b3b0">tempest-AttachVolumeTestJSON-2127223018</nova:project>
Nov 06 06:21:51 user nova-compute[74903]:       </nova:owner>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:21:51 user nova-compute[74903]:       <nova:ports>
Nov 06 06:21:51 user nova-compute[74903]:         <nova:port uuid="f6531ffa-c360-4977-94ba-25ccf8e2474e">
Nov 06 06:21:51 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:21:51 user nova-compute[74903]:         </nova:port>
Nov 06 06:21:51 user nova-compute[74903]:       </nova:ports>
Nov 06 06:21:51 user nova-compute[74903]:     </nova:instance>
Nov 06 06:21:51 user nova-compute[74903]:   </metadata>
Nov 06 06:21:51 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:21:51 user nova-compute[74903]:     <system>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="serial">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="uuid">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:21:51 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:21:51 user nova-compute[74903]:     </system>
Nov 06 06:21:51 user nova-compute[74903]:   </sysinfo>
Nov 06 06:21:51 user nova-compute[74903]:   <os>
Nov 06 06:21:51 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:21:51 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:21:51 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:21:51 user nova-compute[74903]:   </os>
Nov 06 06:21:51 user nova-compute[74903]:   <features>
Nov 06 06:21:51 user nova-compute[74903]:     <acpi/>
Nov 06 06:21:51 user nova-compute[74903]:     <apic/>
Nov 06 06:21:51 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:21:51 user nova-compute[74903]:   </features>
Nov 06 06:21:51 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:21:51 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:21:51 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:21:51 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:21:51 user nova-compute[74903]:   </clock>
Nov 06 06:21:51 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:21:51 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:21:51 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:21:51 user nova-compute[74903]:   </cpu>
Nov 06 06:21:51 user nova-compute[74903]:   <devices>
Nov 06 06:21:51 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:21:51 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:21:51 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk"/>
Nov 06 06:21:51 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:21:51 user nova-compute[74903]:     </disk>
Nov 06 06:21:51 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:21:51 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:21:51 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:21:51 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:21:51 user nova-compute[74903]:       <serial>a4b7c253-eab4-498a-bd8d-9f9cd43089ec</serial>
Nov 06 06:21:51 user nova-compute[74903]:     </disk>
Nov 06 06:21:51 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:21:51 user nova-compute[74903]:       <mac address="fa:16:3e:58:e8:a8"/>
Nov 06 06:21:51 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:51 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:21:51 user nova-compute[74903]:       <target dev="tapf6531ffa-c3"/>
Nov 06 06:21:51 user nova-compute[74903]:     </interface>
Nov 06 06:21:51 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:21:51 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/console.log" append="off"/>
Nov 06 06:21:51 user nova-compute[74903]:     </serial>
Nov 06 06:21:51 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:21:51 user nova-compute[74903]:     <video>
Nov 06 06:21:51 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:21:51 user nova-compute[74903]:     </video>
Nov 06 06:21:51 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:21:51 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:21:51 user nova-compute[74903]:     </rng>
Nov 06 06:21:51 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:21:51 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:21:51 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:21:51 user nova-compute[74903]:     </memballoon>
Nov 06 06:21:51 user nova-compute[74903]:   </devices>
Nov 06 06:21:51 user nova-compute[74903]: </domain>
Nov 06 06:21:51 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:21:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.224s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Cannot resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'migration_context' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.objects.base [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG os_vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27311ea9-d5bc-5ebe-893b-7d45b7a71a7b', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6531ffa-c3, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6531ffa-c3, col_values=(('qos', UUID('699ef6aa-6b31-4e51-a2b8-5e5640f3fbb5')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6531ffa-c3, col_values=(('external_ids', {'iface-id': 'f6531ffa-c360-4977-94ba-25ccf8e2474e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e8:a8', 'vm-uuid': '8d8c3ba8-856b-4e95-800d-7d4b8ab946fc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:21:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:52 user nova-compute[74903]: INFO os_vif [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:21:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:54 user nova-compute[74903]: WARNING nova.compute.manager [req-0c4e662e-edfb-4cbb-922b-7394eb20245a req-18f2c891-8951-4757-bea6-d6e93ddd0233 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state powering-on.
Nov 06 06:21:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:21:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:21:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:21:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:21:56 user nova-compute[74903]: DEBUG nova.compute.manager [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:21:56 user nova-compute[74903]: WARNING nova.compute.manager [req-6e6c44c9-2cd0-4482-b1d8-c877accc1fed req-e920793d-b714-4a0d-b9c2-ed12a2dd1c97 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state powering-on.
Nov 06 06:21:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:21:56 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance rebooted successfully.
Nov 06 06:21:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6d366362-dbef-4cf8-908e-6d92e0d6b456 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:21:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:21:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:22:12 user nova-compute[74903]: INFO nova.compute.claims [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Claim successful on node user
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:22:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.policy [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:22:12 user nova-compute[74903]: INFO nova.virt.block_device [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Booting with volume 559e3cfb-cab5-41aa-9969-a3f7584acfee at /dev/vda
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.utils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6790f4-6aa8-4b92-8aa2-49f49526b067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd5e91-7d21-494e-a428-4119e2ed77ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1a9cf0-ef51-4e98-8d5f-7ff83185183e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[68116e8b-b540-4c6f-9a9e-a8e97cbfe76d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:22:12 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:22:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8737ce50-69a8-49b9-9f46-6d98dbe8523f]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG os_brick.utils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:22:12 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updating existing volume attachment record: 4abce936-4c2f-4dfa-bf3e-389fc370f459 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Successfully created port: 05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Successfully updated port: 05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-changed-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Refreshing instance network info cache due to event network-changed-05a265bf-97f2-4d18-9279-f3387e145df1. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] Acquiring lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:22:13 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updating instance_info_cache with network_info: [{"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Instance network_info: |[{"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] Acquired lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Refreshing network info cache for port 05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updated VIF entry in instance network info cache for port 05a265bf-97f2-4d18-9279-f3387e145df1. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updating instance_info_cache with network_info: [{"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:22:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5d7fd958-d008-4eca-a22f-82bcfb8c0ff5 req-850e4909-0316-4fb1-baae-4aa96d17b7e1 service nova] Releasing lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:22:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Skipping network cache update for instance because it is Building. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:22:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:22:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:22:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:22:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8370MB free_disk=25.174434661865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bffa2829-0129-4874-b8a0-414651356cb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance e81183fa-470e-494d-9e07-c216b9a08e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'flavor' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:39 user nova-compute[74903]: INFO nova.compute.manager [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attaching volume e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 to /dev/vdb
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.utils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352889e-2c23-46a0-941f-aefd3319651a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bd648f-c46e-4c43-97b5-e4a98220f8a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8958d-8564-4e95-bcc7-c2a3db4b857b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c8039e-ee4a-4ec2-8a2a-c61e33620bc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:22:39 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:22:39 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd3a0ab-4e1e-4ba8-ae6a-5d0d9fa08727]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG os_brick.utils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:22:39 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating existing volume attachment record: 4f000e16-34ae-4e1c-9c5e-a074c66da829 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:22:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:22:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:22:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Creating image(s)
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Ensure instance console log exists: /opt/stack/data/nova/instances/9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Start _get_guest_xml network_info=[{"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmcbdVUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e', 'attached_at': '', 'detached_at': '', 'volume_id': '559e3cfb-cab5-41aa-9969-a3f7584acfee', 'serial': '559e3cfb-cab5-41aa-9969-a3f7584acfee'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '4abce936-4c2f-4dfa-bf3e-389fc370f459', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:22:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:22:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmcbdVUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:22:48 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:22:48 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:22:48 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a642dff5-3974-4867-841c-ce9ebdb89569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:22:48 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1410af9-e7d2-4850-875b-1598a54c9db5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee] added
Nov 06 06:22:48 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c0290-3ed3-4f9c-8b94-701f9505f719]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae781cfe-314c-460b-8633-5df8cfae5d75]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmcbdVUx {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmcbdVUx" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c5ce95-e5e0-4206-85a5-d19f1e8dec18]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmcbdVUx'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:48 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[901520c8-91de-41e5-b368-23933f320e89]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c670484e-3d81-42fb-9dfb-3579c793a268]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:22:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:22:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[51675139-d9a6-474b-a57a-2036ac674fa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260]
Nov 06 06:22:49 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260] successful.
Nov 06 06:22:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bede64c-c108-4fee-aa26-ca8eb6a45ab4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baacc68-a8d4-4bed-8dc6-01c416b4a64e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:22:49 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:22:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:22:49 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:22:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f46ae-c818-43a5-ab85-954294b6196b]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:22:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmcbdVUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23535303966303964', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535303966303964', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-363128844',display_name='tempest-TestVolumeBootPattern-volume-backed-server-363128844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-363128844',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnUw8ND3xyvkI39tHP8/AqFDCU0PeT9tCXS0Q2p6tbNbRsbpW3EJW1RL2srVQdRxEJNiIu5VMUOMKcosqh4sw1Ob80kwDdIyry54Ui2DuW6/VcffTIS0GUAANR93YbFvw==',key_name='tempest-keypair-443376449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-qqvraou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:22:50 user nova-compute[74903]:   <uuid>9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e</uuid>
Nov 06 06:22:50 user nova-compute[74903]:   <name>instance-00000029</name>
Nov 06 06:22:50 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:22:50 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:22:50 user nova-compute[74903]:   <metadata>
Nov 06 06:22:50 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:22:50 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:22:50 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-363128844</nova:name>
Nov 06 06:22:50 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:22:48</nova:creationTime>
Nov 06 06:22:50 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:22:50 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:22:50 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:22:50 user nova-compute[74903]:       <nova:owner>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:22:50 user nova-compute[74903]:       </nova:owner>
Nov 06 06:22:50 user nova-compute[74903]:       <nova:ports>
Nov 06 06:22:50 user nova-compute[74903]:         <nova:port uuid="05a265bf-97f2-4d18-9279-f3387e145df1">
Nov 06 06:22:50 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 06:22:50 user nova-compute[74903]:         </nova:port>
Nov 06 06:22:50 user nova-compute[74903]:       </nova:ports>
Nov 06 06:22:50 user nova-compute[74903]:     </nova:instance>
Nov 06 06:22:50 user nova-compute[74903]:   </metadata>
Nov 06 06:22:50 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:22:50 user nova-compute[74903]:     <system>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="serial">9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e</entry>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="uuid">9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e</entry>
Nov 06 06:22:50 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:22:50 user nova-compute[74903]:     </system>
Nov 06 06:22:50 user nova-compute[74903]:   </sysinfo>
Nov 06 06:22:50 user nova-compute[74903]:   <os>
Nov 06 06:22:50 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:22:50 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:22:50 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:22:50 user nova-compute[74903]:   </os>
Nov 06 06:22:50 user nova-compute[74903]:   <features>
Nov 06 06:22:50 user nova-compute[74903]:     <acpi/>
Nov 06 06:22:50 user nova-compute[74903]:     <apic/>
Nov 06 06:22:50 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:22:50 user nova-compute[74903]:   </features>
Nov 06 06:22:50 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:22:50 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:22:50 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:22:50 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:22:50 user nova-compute[74903]:   </clock>
Nov 06 06:22:50 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:22:50 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:22:50 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:22:50 user nova-compute[74903]:   </cpu>
Nov 06 06:22:50 user nova-compute[74903]:   <devices>
Nov 06 06:22:50 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:22:50 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:22:50 user nova-compute[74903]:       <source dev="/dev/sdc"/>
Nov 06 06:22:50 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:22:50 user nova-compute[74903]:       <serial>559e3cfb-cab5-41aa-9969-a3f7584acfee</serial>
Nov 06 06:22:50 user nova-compute[74903]:     </disk>
Nov 06 06:22:50 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:22:50 user nova-compute[74903]:       <mac address="fa:16:3e:ad:01:c3"/>
Nov 06 06:22:50 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:22:50 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:22:50 user nova-compute[74903]:       <target dev="tap05a265bf-97"/>
Nov 06 06:22:50 user nova-compute[74903]:     </interface>
Nov 06 06:22:50 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:22:50 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e/console.log" append="off"/>
Nov 06 06:22:50 user nova-compute[74903]:     </serial>
Nov 06 06:22:50 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:22:50 user nova-compute[74903]:     <video>
Nov 06 06:22:50 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:22:50 user nova-compute[74903]:     </video>
Nov 06 06:22:50 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:22:50 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:22:50 user nova-compute[74903]:     </rng>
Nov 06 06:22:50 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:22:50 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:22:50 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:22:50 user nova-compute[74903]:     </memballoon>
Nov 06 06:22:50 user nova-compute[74903]:   </devices>
Nov 06 06:22:50 user nova-compute[74903]: </domain>
Nov 06 06:22:50 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-363128844',display_name='tempest-TestVolumeBootPattern-volume-backed-server-363128844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-363128844',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnUw8ND3xyvkI39tHP8/AqFDCU0PeT9tCXS0Q2p6tbNbRsbpW3EJW1RL2srVQdRxEJNiIu5VMUOMKcosqh4sw1Ob80kwDdIyry54Ui2DuW6/VcffTIS0GUAANR93YbFvw==',key_name='tempest-keypair-443376449',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-qqvraou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:22:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG os_vif [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1252bf3-8b78-5a71-87de-ac46d783460a', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05a265bf-97, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05a265bf-97, col_values=(('qos', UUID('e3c299be-d80d-4a1e-9026-d3010345765a')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05a265bf-97, col_values=(('external_ids', {'iface-id': '05a265bf-97f2-4d18-9279-f3387e145df1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:01:c3', 'vm-uuid': '9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:50 user nova-compute[74903]: INFO os_vif [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97')
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:22:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:ad:01:c3, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:51 user nova-compute[74903]: DEBUG nova.compute.manager [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:22:51 user nova-compute[74903]: WARNING nova.compute.manager [req-9008d4e9-1520-4afd-a9b6-20aeb3343f08 req-b2edad8d-894b-4608-98c4-3073da78e518 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state building and task_state spawning.
Nov 06 06:22:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.compute.manager [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:22:53 user nova-compute[74903]: WARNING nova.compute.manager [req-76852975-6725-428a-b770-dcae23bca243 req-d8f84729-654a-4429-94b2-c5a55ee5eeef service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state building and task_state spawning.
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:22:53 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Instance spawned successfully.
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:22:54 user nova-compute[74903]: INFO nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 06 06:22:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:22:54 user nova-compute[74903]: INFO nova.compute.manager [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Took 41.92 seconds to build instance.
Nov 06 06:22:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-48b7fbc4-2d01-46d7-a6af-bddff09f5a4b tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.016s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:22:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:22:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:23:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:23:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-changed-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG nova.compute.manager [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Refreshing instance network info cache due to event network-changed-259a970a-b92b-4eb1-82a7-27d2377a65c2. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] Acquiring lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] Acquired lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:23:25 user nova-compute[74903]: DEBUG nova.network.neutron [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Refreshing network info cache for port 259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updated VIF entry in instance network info cache for port 259a970a-b92b-4eb1-82a7-27d2377a65c2. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG nova.network.neutron [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating instance_info_cache with network_info: [{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-269a8209-9b7c-4da4-86a7-84f7ccfefc60 req-579e43e5-94ee-4e8f-bce3-e7b919302489 service nova] Releasing lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG nova.objects.instance [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:26 user nova-compute[74903]: INFO nova.compute.manager [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attaching volume 26d4864d-e556-43b9-9bf7-72f1befe5770 to /dev/vdb
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83459506-fbe6-491e-9851-69b4cdc8eca5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c86600-ee22-4846-b03b-5a5040b0e0a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6325b86-357a-4845-988e-46055f716cb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5a6475-6f62-4d51-9761-ec5b2d5613c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:26 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:23:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5789af-087c-4723-8694-85cd0decc51a]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:26 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating existing volume attachment record: 8b482dd8-b4d1-4f46-9f46-eade134d045b {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:23:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:23:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:30 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:30 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a2af9-90cf-4392-9232-d8efc3387e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:23:30 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0470c168-cab1-41a4-a0dc-0d96dbace9a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95] added
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9f991-4ec1-419a-ac0f-78a17044d9f5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd03134-127a-4f98-94a6-27d7939a2cbd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MldWvFCj {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MldWvFCj" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aec0b4-89bd-40d1-9c22-0ed71c6f6789]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MldWvFCj'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0abf6a-3235-4b06-b5dc-c9e566bae003]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e97836-75e6-4601-b9b7-7616320a4777]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f0742f-b856-491f-a944-fce6ec0089ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260]
Nov 06 06:23:30 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260] successful.
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b62bc-ceb3-4bc5-a1ac-42308968785d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682cb12-356f-4238-b474-9f79d20c7c34]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:30 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:30 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a869512c-3b68-4ba3-b3bc-0043e54ffb64]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:23:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23935626232373861', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935626232373861', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'flavor' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:23:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:23:31 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:23:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:23:31 user nova-compute[74903]:   <serial>e0fa7f1f-4e9e-4a14-bea5-e564a1324d95</serial>
Nov 06 06:23:31 user nova-compute[74903]: </disk>
Nov 06 06:23:31 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No VIF found with MAC fa:16:3e:d7:93:9e, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:23:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ef7c4013-ffa1-45ac-8a7b-e5d98f1d0a9d tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.806s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:33 user nova-compute[74903]: INFO nova.compute.manager [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Rescuing
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-changed-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Refreshing instance network info cache due to event network-changed-2c405138-3e8e-4db3-afb3-06c8cd1122de. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] Acquiring lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] Acquired lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Refreshing network info cache for port 2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:23:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updated VIF entry in instance network info cache for port 2c405138-3e8e-4db3-afb3-06c8cd1122de. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updating instance_info_cache with network_info: [{"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f6cf5a3c-02fc-4dbc-b98c-997933830fc8 req-9387697c-5804-441e-907c-2512f1aa7155 service nova] Releasing lock "refresh_cache-e81183fa-470e-494d-9e07-c216b9a08e6f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:23:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance destroyed successfully.
Nov 06 06:23:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attempting a stable device rescue
Nov 06 06:23:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74903) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance directory exists: not creating {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 06:23:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Creating image(s)
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:23:35 user nova-compute[74903]: WARNING nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state active and task_state rescuing.
Nov 06 06:23:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:23:35 user nova-compute[74903]: WARNING nova.compute.manager [req-238c1161-69e3-452e-a3df-df8cb5e5bb82 req-c3bcfc4c-bf40-4190-8404-aa0952032b94 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state active and task_state rescuing.
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.virt.images [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] d4118f03-e131-4f2b-9716-7592fedf6aab was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.part /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.part /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.converted" returned: 0 in 0.451s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.871s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d,backing_fmt=raw /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d,backing_fmt=raw /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue" returned: 0 in 0.053s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "aa757cf2b27473bed1db9f732cb161d2e7ed2f5d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'migration_context' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Object Instance<a0337bf8-e941-4b21-8b87-580831eec57f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start _get_guest_xml network_info=[{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "vif_mac": "fa:16:3e:d7:93:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd4118f03-e131-4f2b-9716-7592fedf6aab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a0337bf8-e941-4b21-8b87-580831eec57f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'serial': 'e0fa7f1f-4e9e-4a14-bea5-e564a1324d95'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '4f000e16-34ae-4e1c-9c5e-a074c66da829', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'resources' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Object Instance<a0337bf8-e941-4b21-8b87-580831eec57f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'numa_topology' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Object Instance<a0337bf8-e941-4b21-8b87-580831eec57f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:23:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:23:37 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Object Instance<a0337bf8-e941-4b21-8b87-580831eec57f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:37 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:37 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:37 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:23:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[03127d55-5347-41c1-88a6-19e743721601]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MldWvFCj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 06:23:37 user nova-compute[74903]: node.name = iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:23:37 user nova-compute[74903]: node.tpgt = -1
Nov 06 06:23:37 user nova-compute[74903]: node.startup = automatic
Nov 06 06:23:37 user nova-compute[74903]: node.leading_login = No
Nov 06 06:23:37 user nova-compute[74903]: iface.iscsi_ifacename = default
Nov 06 06:23:37 user nova-compute[74903]: iface.net_ifacename = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.ipaddress = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.prefix_len = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.hwaddress = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.transport_name = tcp
Nov 06 06:23:37 user nova-compute[74903]: iface.initiatorname = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.vlan_id = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.vlan_priority = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.vlan_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.iface_num = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.mtu = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.port = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.bootproto = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.subnet_mask = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.gateway = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_alt_client_id = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_dns = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_learn_iqn = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_vendor_id_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_vendor_id = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.dhcp_slp_da = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.fragmentation = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.gratuitous_arp = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.incoming_forwarding = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.tos_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.tos = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.ttl = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.delayed_ack = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.tcp_nagle = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.tcp_wsf_state = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.tcp_wsf = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.tcp_timer_scale = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.tcp_timestamp = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.redirect = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.def_task_mgmt_timeout = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.header_digest = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.data_digest = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.immediate_data = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.initial_r2t = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.data_seq_inorder = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.data_pdu_inorder = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.erl = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.max_receive_data_len = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.first_burst_len = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.max_outstanding_r2t = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.max_burst_len = 0
Nov 06 06:23:37 user nova-compute[74903]: iface.chap_auth = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.bidi_chap = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.strict_login_compliance = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.discovery_auth = <empty>
Nov 06 06:23:37 user nova-compute[74903]: iface.discovery_logout = <empty>
Nov 06 06:23:37 user nova-compute[74903]: node.discovery_address = <empty>
Nov 06 06:23:37 user nova-compute[74903]: node.discovery_port = 0
Nov 06 06:23:37 user nova-compute[74903]: node.discovery_type = static
Nov 06 06:23:37 user nova-compute[74903]: node.session.initial_cmdsn = 0
Nov 06 06:23:37 user nova-compute[74903]: node.session.initial_login_retry_max = 8
Nov 06 06:23:37 user nova-compute[74903]: node.session.xmit_thread_priority = -20
Nov 06 06:23:37 user nova-compute[74903]: node.session.cmds_max = 128
Nov 06 06:23:37 user nova-compute[74903]: node.session.queue_depth = 32
Nov 06 06:23:37 user nova-compute[74903]: node.session.nr_sessions = 1
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.authmethod = CHAP
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.username = MldWvFCj
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.password = ***
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.username_in = <empty>
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.password_in = <empty>
Nov 06 06:23:37 user nova-compute[74903]: node.session.auth.chap_algs = MD5
Nov 06 06:23:37 user nova-compute[74903]: node.session.timeo.replacement_timeout = 120
Nov 06 06:23:37 user nova-compute[74903]: node.session.err_timeo.abort_timeout = 15
Nov 06 06:23:37 user nova-compute[74903]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 06:23:37 user nova-compute[74903]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 06:23:37 user nova-compute[74903]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.FastAbort = Yes
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.InitialR2T = No
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.ImmediateData = Yes
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.MaxConnections = 1
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 06:23:37 user nova-compute[74903]: node.session.iscsi.ERL = 0
Nov 06 06:23:37 user nova-compute[74903]: node.session.scan = manual
Nov 06 06:23:37 user nova-compute[74903]: node.session.reopen_max = 0
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].address = 172.16.0.220
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].port = 3260
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].startup = manual
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].tcp.window_size = 524288
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].tcp.type_of_service = 0
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].timeo.logout_timeout = 15
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].timeo.login_timeout = 15
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].timeo.auth_timeout = 45
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.DataDigest = None
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.IFMarker = No
Nov 06 06:23:37 user nova-compute[74903]: node.conn[0].iscsi.OFMarker = No
Nov 06 06:23:37 user nova-compute[74903]: # END RECORD
Nov 06 06:23:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9e3d35-b994-4a37-afe0-a8a37bd03aec]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1f4515-ed46-4775-950d-3fbf56307299]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MldWvFCj {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MldWvFCj" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d3a33a-a517-4fda-a8e9-f7f829c5a21c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MldWvFCj'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea178ae-5b49-4f0a-8078-f6a13acf4ce2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b115ca-05b8-4b83-b65e-7d6339ec3ef1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:37 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:37 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:37 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:37 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:37 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.192s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] HCTL ('35', '0', '0', 0) found on session 45 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f2cf8-5e4d-472d-b343-237fea7101df]: (4, ('0 0 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Searching for a device in session 45 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] <== connect_volume: return (216ms) {'type': 'block', 'scsi_wwn': '23935626232373861', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935626232373861', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987042337',display_name='tempest-ServerStableDeviceRescueTest-server-1987042337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1987042337',id=38,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByt1pI2/SsEmmqiAssLT6BTfxA6sUPgigNIlwoLXLrehdOwXtEaY/YlVx5Z+rVvkv+ALYzCRWIBn9D+0jBeFKyO1FN9d56SJpxDf9WBOi1GbRESgsFeGLYNtfrM2SxXqg==',key_name='tempest-keypair-1589938492',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1b5857e46dc41849562a385ea14ff4e',ramdisk_id='',reservation_id='r-zpjznmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-263532306',owner_user_name='tempest-ServerStableDeviceRescueTest-263532306-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='464230a135f94828b7f04a9bf10a3ab4',uuid=a0337bf8-e941-4b21-8b87-580831eec57f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "vif_mac": "fa:16:3e:d7:93:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converting VIF {"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "vif_mac": "fa:16:3e:d7:93:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'pci_devices' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.objects.base [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Object Instance<a0337bf8-e941-4b21-8b87-580831eec57f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:23:37 user nova-compute[74903]:   <uuid>a0337bf8-e941-4b21-8b87-580831eec57f</uuid>
Nov 06 06:23:37 user nova-compute[74903]:   <name>instance-00000026</name>
Nov 06 06:23:37 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:23:37 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:23:37 user nova-compute[74903]:   <metadata>
Nov 06 06:23:37 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:23:37 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1987042337</nova:name>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:23:37</nova:creationTime>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:23:37 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:23:37 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:owner>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:user uuid="464230a135f94828b7f04a9bf10a3ab4">tempest-ServerStableDeviceRescueTest-263532306-project-member</nova:user>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:project uuid="f1b5857e46dc41849562a385ea14ff4e">tempest-ServerStableDeviceRescueTest-263532306</nova:project>
Nov 06 06:23:37 user nova-compute[74903]:       </nova:owner>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:23:37 user nova-compute[74903]:       <nova:ports>
Nov 06 06:23:37 user nova-compute[74903]:         <nova:port uuid="d4b76b36-9cc0-4275-8eb0-90d70d4a0940">
Nov 06 06:23:37 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:23:37 user nova-compute[74903]:         </nova:port>
Nov 06 06:23:37 user nova-compute[74903]:       </nova:ports>
Nov 06 06:23:37 user nova-compute[74903]:     </nova:instance>
Nov 06 06:23:37 user nova-compute[74903]:   </metadata>
Nov 06 06:23:37 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:23:37 user nova-compute[74903]:     <system>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="serial">a0337bf8-e941-4b21-8b87-580831eec57f</entry>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="uuid">a0337bf8-e941-4b21-8b87-580831eec57f</entry>
Nov 06 06:23:37 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:23:37 user nova-compute[74903]:     </system>
Nov 06 06:23:37 user nova-compute[74903]:   </sysinfo>
Nov 06 06:23:37 user nova-compute[74903]:   <os>
Nov 06 06:23:37 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:23:37 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:23:37 user nova-compute[74903]:   </os>
Nov 06 06:23:37 user nova-compute[74903]:   <features>
Nov 06 06:23:37 user nova-compute[74903]:     <acpi/>
Nov 06 06:23:37 user nova-compute[74903]:     <apic/>
Nov 06 06:23:37 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:23:37 user nova-compute[74903]:   </features>
Nov 06 06:23:37 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:23:37 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:23:37 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:23:37 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:23:37 user nova-compute[74903]:   </clock>
Nov 06 06:23:37 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:23:37 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:23:37 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:23:37 user nova-compute[74903]:   </cpu>
Nov 06 06:23:37 user nova-compute[74903]:   <devices>
Nov 06 06:23:37 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:23:37 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:23:37 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk"/>
Nov 06 06:23:37 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:23:37 user nova-compute[74903]:     </disk>
Nov 06 06:23:37 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:23:37 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:23:37 user nova-compute[74903]:       <source dev="/dev/sdd"/>
Nov 06 06:23:37 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:23:37 user nova-compute[74903]:       <serial>e0fa7f1f-4e9e-4a14-bea5-e564a1324d95</serial>
Nov 06 06:23:37 user nova-compute[74903]:     </disk>
Nov 06 06:23:37 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:23:37 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:23:37 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue"/>
Nov 06 06:23:37 user nova-compute[74903]:       <target dev="vdc" bus="virtio"/>
Nov 06 06:23:37 user nova-compute[74903]:       <boot order="1"/>
Nov 06 06:23:37 user nova-compute[74903]:     </disk>
Nov 06 06:23:37 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:23:37 user nova-compute[74903]:       <mac address="fa:16:3e:d7:93:9e"/>
Nov 06 06:23:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:23:37 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:23:37 user nova-compute[74903]:       <target dev="tapd4b76b36-9c"/>
Nov 06 06:23:37 user nova-compute[74903]:     </interface>
Nov 06 06:23:37 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:23:37 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/console.log" append="off"/>
Nov 06 06:23:37 user nova-compute[74903]:     </serial>
Nov 06 06:23:37 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:23:37 user nova-compute[74903]:     <video>
Nov 06 06:23:37 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:23:37 user nova-compute[74903]:     </video>
Nov 06 06:23:37 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:23:37 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:23:37 user nova-compute[74903]:     </rng>
Nov 06 06:23:37 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:23:37 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:23:37 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:23:37 user nova-compute[74903]:     </memballoon>
Nov 06 06:23:37 user nova-compute[74903]:   </devices>
Nov 06 06:23:37 user nova-compute[74903]: </domain>
Nov 06 06:23:37 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:23:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance destroyed successfully.
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] No VIF found with MAC fa:16:3e:d7:93:9e, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:23:41 user nova-compute[74903]: WARNING nova.compute.manager [req-0773a4f9-d9c9-4d40-a121-10280f8aa1f9 req-deb9960b-5588-4b16-a8df-19e0ffb83499 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state active and task_state rescuing.
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:23:41 user nova-compute[74903]: WARNING nova.compute.manager [req-5ce3a153-be75-47b5-8ffb-b002bf26c102 req-431b37e9-32e4-4d35-89ec-78ed3c494b4a service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state active and task_state rescuing.
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-187c612c-fc59-472e-ac60-9f1f411dab43 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:41 user nova-compute[74903]: INFO nova.compute.manager [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Detaching volume a4b7c253-eab4-498a-bd8d-9f9cd43089ec
Nov 06 06:23:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:23:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.067184448242188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:41 user nova-compute[74903]: INFO nova.virt.block_device [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Attempting to driver detach volume a4b7c253-eab4-498a-bd8d-9f9cd43089ec from mountpoint /dev/vdb
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Attempting to detach device vdb from instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:23:41 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:23:41 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:23:41 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:23:41 user nova-compute[74903]:   <serial>a4b7c253-eab4-498a-bd8d-9f9cd43089ec</serial>
Nov 06 06:23:41 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:23:41 user nova-compute[74903]: </disk>
Nov 06 06:23:41 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:23:41 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdb from instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc from the persistent domain config.
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:23:41 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:23:41 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:23:41 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:23:41 user nova-compute[74903]:   <serial>a4b7c253-eab4-498a-bd8d-9f9cd43089ec</serial>
Nov 06 06:23:41 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:23:41 user nova-compute[74903]: </disk>
Nov 06 06:23:41 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bffa2829-0129-4874-b8a0-414651356cb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance e81183fa-470e-494d-9e07-c216b9a08e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:41 user nova-compute[74903]: INFO nova.compute.manager [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Attaching volume e808eeb6-96c8-48d0-9db1-954f07d9836d to /dev/vdb
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a08d788-b448-47bc-aa50-4e54c4fd6326]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c6db8-fc05-480e-9576-cd8d80a5cfc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cc983a-052e-4a60-8d79-4821dd061555]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cf958b-2454-4bf3-b091-e220399f166b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:41 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:23:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16cb5ad-01e9-4a82-8140-251c3430a516]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG os_brick.utils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:41 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updating existing volume attachment record: c89f9b45-58b8-4650-8267-4bdbe49a4603 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:23:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPaMpVyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:23:50 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5ebdd-1fa2-4b9d-8f6d-0553e957b156]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:23:50 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3165f34f-4c1a-4d4c-9cae-a8f8759b5645]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770] added
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f48397-b2b5-440b-8f00-09b562b35016]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b924ccd6-8cb5-4b85-99fb-69337414916b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPaMpVyT {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NPaMpVyT" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a0e2d-6630-42e4-85b3-0b46fa05caaa]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NPaMpVyT'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a183cd5-b2fb-41e3-a611-0f0d670b725a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9f94ed-8565-470c-95c9-4652d9060def]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[885cda92-1876-4440-abea-7dad42a3d753]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260]
Nov 06 06:23:50 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260] successful.
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5af24b9-07ef-4f93-9747-83b726db52f5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab4cd92-9fa9-47e3-9cf3-0a070b0a8758]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:23:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a176e784-2c1f-4751-b6da-640fba7d848d]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPaMpVyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26235366232383032', 'path': '/dev/sde'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235366232383032', 'path': '/dev/sde'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:23:51 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:23:51 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:23:51 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:23:51 user nova-compute[74903]:   <serial>26d4864d-e556-43b9-9bf7-72f1befe5770</serial>
Nov 06 06:23:51 user nova-compute[74903]: </disk>
Nov 06 06:23:51 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No VIF found with MAC fa:16:3e:6e:1c:04, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:23:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73c6aa25-9a5f-47d8-9591-166d1dd9f799 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.487s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG nova.objects.instance [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:23:55 user nova-compute[74903]: INFO nova.compute.manager [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attaching volume 75e249be-6e44-45e3-ae94-50984c2ebb05 to /dev/vdc
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.utils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1437a77-3c4a-4144-a9a1-ca228a32d414]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58b2014-d027-4730-abc1-7e8cbb8204df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8641dcc9-213a-4184-b974-ae0289551c2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5dce2-4cfa-4786-96ef-9dd7f2a085c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:23:55 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:23:55 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a95794-0c86-4293-8e12-b54d7fa56816]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG os_brick.utils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:23:55 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating existing volume attachment record: d99550b2-a32a-4b95-974f-18108c8ffd74 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:23:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:23:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:02 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc is timed out.
Nov 06 06:24:02 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdb from instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc from the live domain config.
Nov 06 06:24:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FepdruXh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:02 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e88b2c-1f9a-4b5d-9091-fae61dd54073]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:24:02 user nova-compute[74903]: No targets found.
Nov 06 06:24:02 user nova-compute[74903]: iSNS:
Nov 06 06:24:02 user nova-compute[74903]: No targets found.
Nov 06 06:24:02 user nova-compute[74903]: STATIC:
Nov 06 06:24:02 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770
Nov 06 06:24:02 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:02 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:02 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:24:02 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:02 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:02 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:24:02 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:02 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:02 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec
Nov 06 06:24:02 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:02 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:02 user nova-compute[74903]: FIRMWARE:
Nov 06 06:24:02 user nova-compute[74903]: No targets found.
Nov 06 06:24:02 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:24:02 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:24:02 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486f0d1-6227-4646-bd68-db4406d77f1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da5083c-3d58-4b68-9cbb-d58ab30c867a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:02 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:02 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:02 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08616560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1270f34b-2bb5-4c48-a3cd-e178a6fecb9e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2369ba77-dea8-4015-a2da-76ab0ac049e1]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b80078-ded2-45a6-9c8d-6787364e5f7e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8e459-3c98-41c5-a4d5-6af353d0ec60]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53b079f-baea-4365-a0f2-79e6653a4c5a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07474ab-e307-4844-8732-cde44ac8de3e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260]
Nov 06 06:24:02 user nova-compute[74903]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:02 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b7c253-eab4-498a-bd8d-9f9cd43089ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1ee4f-1ff8-43fd-9c0b-833374dd2674]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== disconnect_volume: return (316ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:02 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-changed-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Refreshing instance network info cache due to event network-changed-05a265bf-97f2-4d18-9279-f3387e145df1. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] Acquiring lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] Acquired lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Refreshing network info cache for port 05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6f79bf31-28b2-4405-9a7b-f2e403d0e13b tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updated VIF entry in instance network info cache for port 05a265bf-97f2-4d18-9279-f3387e145df1. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updating instance_info_cache with network_info: [{"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18d72182-8550-43fa-a0ba-caa3213ee004 req-63f216e5-9fe5-48cf-aac7-4c5fda786f8f service nova] Releasing lock "refresh_cache-9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74903) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:04 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance destroyed successfully.
Nov 06 06:24:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:24:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a80997f3-eb7a-49f8-a3d5-f763a6415708 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.850s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:24:05 user nova-compute[74903]: WARNING nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state None.
Nov 06 06:24:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:24:05 user nova-compute[74903]: WARNING nova.compute.manager [req-50ef440b-f207-41db-a351-dadec38b1604 req-1c5c3f34-4f7d-4fd4-a6f2-7d0e7db4f4f1 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state None.
Nov 06 06:24:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:24:17 user nova-compute[74903]: INFO nova.compute.claims [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Claim successful on node user
Nov 06 06:24:17 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:24:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:24:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:24:18 user nova-compute[74903]: INFO nova.virt.block_device [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Booting with volume snapshot 90b828d3-0f8d-49d7-8530-de817dbe7deb at /dev/vda
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.policy [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:18 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Successfully created port: 6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Successfully updated port: 6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-changed-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Refreshing instance network info cache due to event network-changed-6e97e520-4bf1-4f70-8778-463bf9733a5f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] Acquiring lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.network.neutron [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updating instance_info_cache with network_info: [{"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Instance network_info: |[{"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] Acquired lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:24:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Refreshing network info cache for port 6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:24:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updated VIF entry in instance network info cache for port 6e97e520-4bf1-4f70-8778-463bf9733a5f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:24:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updating instance_info_cache with network_info: [{"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:24:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3f19e3eb-e9f4-48b9-a420-d88b3cd2c79d req-3d8e9933-ad27-48b0-aa40-315ac870f43a service nova] Releasing lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:24:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG os_brick.utils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f231aec-bb3f-4796-9fe9-a70a5ff21444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f25bad0-0eaf-4fbd-a811-926bf346de6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0761e11-e538-406e-9fd7-776d5a782f88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[255bb465-04be-4f8a-83d1-2ce168f668f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:24:24 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:24:24 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d168939-be14-461f-b6ca-f2bd18970262]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG os_brick.utils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:24 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updating existing volume attachment record: a519e895-69b8-4cfb-a892-58afabb8b161 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znucHjJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:26 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:26 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:26 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea090b26-22a4-4915-a7f7-8510204e9a77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:24:26 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[88164d44-771e-44f4-8186-41a1b681d793]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d] added
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[02726fed-1694-4ca9-ac9f-c54093df8cf3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMWsBbig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:26 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da07495-93f2-46b3-953c-56155664bde9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znucHjJp {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znucHjJp" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[467d9083-3a13-43d1-897c-0ac4e9983224]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znucHjJp'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a814a15-d0c4-4234-8afe-c4a0e50a31c8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9626f142-6de1-474e-9869-345ed3bd07f5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ecbe9-b7ce-4870-b4e9-bf4fb3f4812f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260]
Nov 06 06:24:26 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1916e0e-8c42-4fe5-b867-791d9520e5ba]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08b7d1-777d-4929-8b8a-30a7448522bb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:26 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf77755-b49c-40a4-822e-8cb2993e627c]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znucHjJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating instance_info_cache with network_info: [{"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-bffa2829-0129-4874-b8a0-414651356cb8" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:24:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23966653262343934', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966653262343934', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.362s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:27 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:27 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b82ec-0500-4109-807d-886b8cddb461]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:24:27 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:24:27 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:27 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:24:27 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:24:27 user nova-compute[74903]:   <serial>e808eeb6-96c8-48d0-9db1-954f07d9836d</serial>
Nov 06 06:24:27 user nova-compute[74903]: </disk>
Nov 06 06:24:27 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f2776-79ed-41d5-a16d-15ed8f793b29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05] added
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e651b-7f00-4f6b-be4b-c252d47ccfc2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[045be114-b43d-4d90-87c0-c7ac17b0715a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMWsBbig {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMWsBbig" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af392aa5-5474-4202-b953-0a57f017c1e5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMWsBbig'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ae894-1ae2-47f5-88a3-4e28bc9b4c2d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[55125384-a6b5-4fad-af68-7f0ae532a160]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0841650b-a0bc-4a47-98b4-a375b616c7e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260]
Nov 06 06:24:27 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82bbf09-320a-4521-949c-152d23fa6fa1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efa4ca-26e3-4a87-ae6e-2b6acc218e6e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:27 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6097df-865a-4bd2-a0c9-b41acab00676]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:b5:9d:b8, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d6354e8e-77c5-4839-ab45-45c27450e9e7 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.430s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:28 user nova-compute[74903]: INFO nova.compute.manager [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Detaching volume e808eeb6-96c8-48d0-9db1-954f07d9836d
Nov 06 06:24:28 user nova-compute[74903]: INFO nova.virt.block_device [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Attempting to driver detach volume e808eeb6-96c8-48d0-9db1-954f07d9836d from mountpoint /dev/vdb
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Attempting to detach device vdb from instance e81183fa-470e-494d-9e07-c216b9a08e6f from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:24:28 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:28 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:24:28 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:24:28 user nova-compute[74903]:   <serial>e808eeb6-96c8-48d0-9db1-954f07d9836d</serial>
Nov 06 06:24:28 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:24:28 user nova-compute[74903]: </disk>
Nov 06 06:24:28 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:24:28 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance e81183fa-470e-494d-9e07-c216b9a08e6f from the persistent domain config.
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e81183fa-470e-494d-9e07-c216b9a08e6f from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:24:28 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:28 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:24:28 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:24:28 user nova-compute[74903]:   <serial>e808eeb6-96c8-48d0-9db1-954f07d9836d</serial>
Nov 06 06:24:28 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:24:28 user nova-compute[74903]: </disk>
Nov 06 06:24:28 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMWsBbig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== connect_volume: return (2702ms) {'type': 'block', 'scsi_wwn': '23961336564353232', 'path': '/dev/sdf'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961336564353232', 'path': '/dev/sdf'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.objects.instance [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:24:28 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:28 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:24:28 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:24:28 user nova-compute[74903]:   <serial>75e249be-6e44-45e3-ae94-50984c2ebb05</serial>
Nov 06 06:24:28 user nova-compute[74903]: </disk>
Nov 06 06:24:28 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] No VIF found with MAC fa:16:3e:6e:1c:04, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-30923886-e98d-446f-aa91-1c4df6320e02 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.164s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:24:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:30 user nova-compute[74903]: INFO nova.compute.manager [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Detaching volume 75e249be-6e44-45e3-ae94-50984c2ebb05
Nov 06 06:24:30 user nova-compute[74903]: INFO nova.virt.block_device [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attempting to driver detach volume 75e249be-6e44-45e3-ae94-50984c2ebb05 from mountpoint /dev/vdc
Nov 06 06:24:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Attempting to detach device vdc from instance bffa2829-0129-4874-b8a0-414651356cb8 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:24:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:24:30 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:30 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:24:30 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:24:30 user nova-compute[74903]:   <serial>75e249be-6e44-45e3-ae94-50984c2ebb05</serial>
Nov 06 06:24:30 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:24:30 user nova-compute[74903]: </disk>
Nov 06 06:24:30 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:24:30 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully detached device vdc from instance bffa2829-0129-4874-b8a0-414651356cb8 from the persistent domain config.
Nov 06 06:24:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bffa2829-0129-4874-b8a0-414651356cb8 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:24:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:24:30 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:30 user nova-compute[74903]:   <source dev="/dev/sdf"/>
Nov 06 06:24:30 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:24:30 user nova-compute[74903]:   <serial>75e249be-6e44-45e3-ae94-50984c2ebb05</serial>
Nov 06 06:24:30 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:24:30 user nova-compute[74903]: </disk>
Nov 06 06:24:30 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:24:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:36 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:24:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:24:38 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.06452178955078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bffa2829-0129-4874-b8a0-414651356cb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance e81183fa-470e-494d-9e07-c216b9a08e6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance d5b15233-20c0-4717-b94f-ccb708c3fb09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:24:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:24:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:24:47 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Creating image(s)
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Ensure instance console log exists: /opt/stack/data/nova/instances/d5b15233-20c0-4717-b94f-ccb708c3fb09/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Start _get_guest_xml network_info=[{"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T06:24:05Z,direct_url=<?>,disk_format='qcow2',id=c4cc0c67-5343-42ff-8443-d57acdcb72e7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-154754266',owner='f4ca8acfbfb24a858078fcd5fd25f2fe',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T06:24:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeQfEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5b15233-20c0-4717-b94f-ccb708c3fb09', 'attached_at': '', 'detached_at': '', 'volume_id': '38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 'serial': '38b461dd-15a1-4ea1-ad51-99186bc5bbc1'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a519e895-69b8-4cfb-a892-58afabb8b161', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:24:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:24:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T06:24:05Z,direct_url=<?>,disk_format='qcow2',id=c4cc0c67-5343-42ff-8443-d57acdcb72e7,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-154754266',owner='f4ca8acfbfb24a858078fcd5fd25f2fe',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T06:24:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeQfEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:47 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:47 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:47 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b96b1f-15ef-4307-970e-0ae5a0a6733d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:24:47 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[200c3800-6401-4fd9-ae16-861bca686217]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1] added
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285f4f0-333d-4a43-8912-a4b01d52c418]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be5da76-7526-40ca-902f-804f914a333c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZeQfEaj {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZeQfEaj" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55c7ed9-e09d-44d0-b955-f1c85a456a2e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZeQfEaj'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920d50d-8e02-4e25-9b89-4f2e74119ef3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8899b31a-bd51-4872-8f07-7ff22459b775]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9caae5-c494-412c-9132-680a0d7b3215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260]
Nov 06 06:24:47 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f58d4b-1696-42ca-9865-63d403517262]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8a7412-7a8d-44b5-8804-4225bf0ddd0d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:47 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d9546-f52a-4462-8cb9-8356d1f3a5ab]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:24:47 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeQfEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23166333434376239', 'path': '/dev/sdg'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166333434376239', 'path': '/dev/sdg'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1255349431',id=42,image_ref='c4cc0c67-5343-42ff-8443-d57acdcb72e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA77xMna316gD79JXmvWmTrWmBCKXruvsIGF6ytAgNc0gd9YnQljAEnfDcQs3Ptie3G4XKlN2Hlb+TUWVHEgRfygaQRcdmxs/x6KpGVOvdPDf+HELCfxSNuUSzr9jkfHw==',key_name='tempest-keypair-1139854666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-m88wq7oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-251399615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=d5b15233-20c0-4717-b94f-ccb708c3fb09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.objects.instance [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b15233-20c0-4717-b94f-ccb708c3fb09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:24:48 user nova-compute[74903]:   <uuid>d5b15233-20c0-4717-b94f-ccb708c3fb09</uuid>
Nov 06 06:24:48 user nova-compute[74903]:   <name>instance-0000002a</name>
Nov 06 06:24:48 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:24:48 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:24:48 user nova-compute[74903]:   <metadata>
Nov 06 06:24:48 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:24:48 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1255349431</nova:name>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:24:47</nova:creationTime>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:24:48 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:24:48 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:owner>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:24:48 user nova-compute[74903]:       </nova:owner>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:root type="image" uuid="c4cc0c67-5343-42ff-8443-d57acdcb72e7"/>
Nov 06 06:24:48 user nova-compute[74903]:       <nova:ports>
Nov 06 06:24:48 user nova-compute[74903]:         <nova:port uuid="6e97e520-4bf1-4f70-8778-463bf9733a5f">
Nov 06 06:24:48 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 06:24:48 user nova-compute[74903]:         </nova:port>
Nov 06 06:24:48 user nova-compute[74903]:       </nova:ports>
Nov 06 06:24:48 user nova-compute[74903]:     </nova:instance>
Nov 06 06:24:48 user nova-compute[74903]:   </metadata>
Nov 06 06:24:48 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:24:48 user nova-compute[74903]:     <system>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="serial">d5b15233-20c0-4717-b94f-ccb708c3fb09</entry>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="uuid">d5b15233-20c0-4717-b94f-ccb708c3fb09</entry>
Nov 06 06:24:48 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:24:48 user nova-compute[74903]:     </system>
Nov 06 06:24:48 user nova-compute[74903]:   </sysinfo>
Nov 06 06:24:48 user nova-compute[74903]:   <os>
Nov 06 06:24:48 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:24:48 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:24:48 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:24:48 user nova-compute[74903]:   </os>
Nov 06 06:24:48 user nova-compute[74903]:   <features>
Nov 06 06:24:48 user nova-compute[74903]:     <acpi/>
Nov 06 06:24:48 user nova-compute[74903]:     <apic/>
Nov 06 06:24:48 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:24:48 user nova-compute[74903]:   </features>
Nov 06 06:24:48 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:24:48 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:24:48 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:24:48 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:24:48 user nova-compute[74903]:   </clock>
Nov 06 06:24:48 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:24:48 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:24:48 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:24:48 user nova-compute[74903]:   </cpu>
Nov 06 06:24:48 user nova-compute[74903]:   <devices>
Nov 06 06:24:48 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:24:48 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:24:48 user nova-compute[74903]:       <source dev="/dev/sdg"/>
Nov 06 06:24:48 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:24:48 user nova-compute[74903]:       <serial>38b461dd-15a1-4ea1-ad51-99186bc5bbc1</serial>
Nov 06 06:24:48 user nova-compute[74903]:     </disk>
Nov 06 06:24:48 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:24:48 user nova-compute[74903]:       <mac address="fa:16:3e:a1:13:64"/>
Nov 06 06:24:48 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:24:48 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:24:48 user nova-compute[74903]:       <target dev="tap6e97e520-4b"/>
Nov 06 06:24:48 user nova-compute[74903]:     </interface>
Nov 06 06:24:48 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:24:48 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/d5b15233-20c0-4717-b94f-ccb708c3fb09/console.log" append="off"/>
Nov 06 06:24:48 user nova-compute[74903]:     </serial>
Nov 06 06:24:48 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:24:48 user nova-compute[74903]:     <video>
Nov 06 06:24:48 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:24:48 user nova-compute[74903]:     </video>
Nov 06 06:24:48 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:24:48 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:24:48 user nova-compute[74903]:     </rng>
Nov 06 06:24:48 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:24:48 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:24:48 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:24:48 user nova-compute[74903]:     </memballoon>
Nov 06 06:24:48 user nova-compute[74903]:   </devices>
Nov 06 06:24:48 user nova-compute[74903]: </domain>
Nov 06 06:24:48 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1255349431',id=42,image_ref='c4cc0c67-5343-42ff-8443-d57acdcb72e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA77xMna316gD79JXmvWmTrWmBCKXruvsIGF6ytAgNc0gd9YnQljAEnfDcQs3Ptie3G4XKlN2Hlb+TUWVHEgRfygaQRcdmxs/x6KpGVOvdPDf+HELCfxSNuUSzr9jkfHw==',key_name='tempest-keypair-1139854666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-m88wq7oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-251399615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=d5b15233-20c0-4717-b94f-ccb708c3fb09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG os_vif [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5142dc1-8418-5018-877f-bbaacaad8213', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e97e520-4b, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e97e520-4b, col_values=(('qos', UUID('e4cf6c41-1254-47f6-94a2-a9fdce8eb8cb')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e97e520-4b, col_values=(('external_ids', {'iface-id': '6e97e520-4bf1-4f70-8778-463bf9733a5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:13:64', 'vm-uuid': 'd5b15233-20c0-4717-b94f-ccb708c3fb09'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:48 user nova-compute[74903]: INFO os_vif [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b')
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:24:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:a1:13:64, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:24:49 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e81183fa-470e-494d-9e07-c216b9a08e6f is timed out.
Nov 06 06:24:49 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance e81183fa-470e-494d-9e07-c216b9a08e6f from the live domain config.
Nov 06 06:24:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znucHjJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:49 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe40c9a-1f31-4e57-baf3-1e7cc7467478]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:24:49 user nova-compute[74903]: No targets found.
Nov 06 06:24:49 user nova-compute[74903]: iSNS:
Nov 06 06:24:49 user nova-compute[74903]: No targets found.
Nov 06 06:24:49 user nova-compute[74903]: STATIC:
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:24:49 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:49 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:49 user nova-compute[74903]: FIRMWARE:
Nov 06 06:24:49 user nova-compute[74903]: No targets found.
Nov 06 06:24:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:24:49 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:24:49 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53590db2-ca75-4591-ac02-78bdd2ef5988]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c90615f-6356-43fc-9866-251d1a433d7b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08616680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdfa559-9734-4bd7-a6dd-3f73dc39f5c4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34249691-d1b4-4ca9-96a4-99e7c3d781e1]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6ed8f7-e61e-4b07-bb9e-f007d6adfd69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[384a213a-cdf0-4bc5-b94a-57b2594f3a5a]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867068c-6242-4100-ab5a-d0dc12d81a12]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2feda9-48d0-439b-96cb-e5acf0d3c6b8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260]
Nov 06 06:24:49 user nova-compute[74903]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:49 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e808eeb6-96c8-48d0-9db1-954f07d9836d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[62276700-f8e0-43d5-8776-b96c7cd74569]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== disconnect_volume: return (285ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:24:50 user nova-compute[74903]: WARNING nova.compute.manager [req-47b149f4-03b1-4dad-851d-38f7b8f18d74 req-52cedbef-9b7a-44b9-9b06-b1e4f4ee6c48 service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state building and task_state spawning.
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-84a30893-43e3-4659-a937-a2e10639eabd tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.170s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:51 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bffa2829-0129-4874-b8a0-414651356cb8 is timed out.
Nov 06 06:24:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully detached device vdc from instance bffa2829-0129-4874-b8a0-414651356cb8 from the live domain config.
Nov 06 06:24:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMWsBbig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:24:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde88234-d2dd-400a-a64d-a4b470d3cdc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:24:51 user nova-compute[74903]: No targets found.
Nov 06 06:24:51 user nova-compute[74903]: iSNS:
Nov 06 06:24:51 user nova-compute[74903]: No targets found.
Nov 06 06:24:51 user nova-compute[74903]: STATIC:
Nov 06 06:24:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770
Nov 06 06:24:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05
Nov 06 06:24:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:24:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1
Nov 06 06:24:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:24:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:24:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:24:51 user nova-compute[74903]: FIRMWARE:
Nov 06 06:24:51 user nova-compute[74903]: No targets found.
Nov 06 06:24:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:24:51 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:24:51 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fc986-4b3a-4cb4-b439-02d4a5367fcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493bb7e-6c1e-4b1f-9463-174f8857f86a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:24:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa087bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05'): ({'sdf'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Removing single pathed devices sdf {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a02d2e1-acfa-4800-a484-c70125f55b4e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c655e289-9e05-40ee-b48d-270f0f24eb10]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Flushing IO for device /dev/sdf {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aea98b-617b-4cb3-a93e-f3932b89221f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5bd076-7bec-40ef-b201-22c267fc9624]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] SCSI volumes sdf have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[989dae1f-2692-4339-8c0d-5598dc5e8149]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[887da8ba-3498-4f1d-825e-4bb4ca57e3d6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260]
Nov 06 06:24:51 user nova-compute[74903]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05, portal: 172.16.0.220,3260] successful.
Nov 06 06:24:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75e249be-6e44-45e3-ae94-50984c2ebb05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e5e2a4-9c7f-4faa-881d-ef9e64ddd64d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== disconnect_volume: return (329ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:24:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:24:52 user nova-compute[74903]: WARNING nova.compute.manager [req-4a9315b3-7a8c-484c-b7c8-c346584cfe9a req-0d4ed352-f3fc-45a9-9b9a-cb9b91414abc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state building and task_state spawning.
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:24:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Instance spawned successfully.
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:24:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fe5f1f54-98c2-411d-87a5-61e25f8c3d23 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.790s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:52 user nova-compute[74903]: INFO nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 06 06:24:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:24:52 user nova-compute[74903]: INFO nova.compute.manager [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Took 34.89 seconds to build instance.
Nov 06 06:24:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-1e93a5b4-db91-4ce6-9c6d-cb5a93a8a770 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.026s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:24:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:24:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:19 user nova-compute[74903]: INFO nova.compute.manager [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Terminating instance
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-unplugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] No waiting events found dispatching network-vif-unplugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-314c9639-51f0-4f65-b4ce-50a3699c9644 req-d5d853d9-03ba-49c4-a0a9-5323da9ae6ec service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-unplugged-2c405138-3e8e-4db3-afb3-06c8cd1122de for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Instance destroyed successfully.
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'resources' on Instance uuid e81183fa-470e-494d-9e07-c216b9a08e6f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1720233683',display_name='tempest-AttachVolumeNegativeTest-server-1720233683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1720233683',id=40,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz4ZZ9GL87vW4s9yLR9wMAOMpv+oPltfFbGFENoXMXH2Oe2rT1XN9WrFqPqCrUiU1jdsTznmZLr9BImSGSiKhylPX16uUeTg9uCvxZGm5A+AJypj88EyoQj3LbUVFr9gQ==',key_name='tempest-keypair-1041408340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:21:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-4itcx9d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=e81183fa-470e-494d-9e07-c216b9a08e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "address": "fa:16:3e:b5:9d:b8", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c405138-3e", "ovs_interfaceid": "2c405138-3e8e-4db3-afb3-06c8cd1122de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG os_vif [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c405138-3e, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=058b746a-b117-424f-ab65-27b23362f182) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:19 user nova-compute[74903]: INFO os_vif [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:9d:b8,bridge_name='br-int',has_traffic_filtering=True,id=2c405138-3e8e-4db3-afb3-06c8cd1122de,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c405138-3e')
Nov 06 06:25:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Deleting instance files /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f_del
Nov 06 06:25:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Deletion of /opt/stack/data/nova/instances/e81183fa-470e-494d-9e07-c216b9a08e6f_del complete
Nov 06 06:25:20 user nova-compute[74903]: INFO nova.compute.manager [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 06 06:25:20 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:25:20 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:25:20 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:25:20 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:25:20 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Took 0.78 seconds to deallocate network for instance.
Nov 06 06:25:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:21 user nova-compute[74903]: INFO nova.compute.manager [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Detaching volume 26d4864d-e556-43b9-9bf7-72f1befe5770
Nov 06 06:25:21 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Deleted allocations for instance e81183fa-470e-494d-9e07-c216b9a08e6f
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7e82e70a-8a39-436a-ae84-a6bbd8d1d293 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:21 user nova-compute[74903]: INFO nova.virt.block_device [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Attempting to driver detach volume 26d4864d-e556-43b9-9bf7-72f1befe5770 from mountpoint /dev/vdb
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Attempting to detach device vdb from instance bffa2829-0129-4874-b8a0-414651356cb8 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:25:21 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:25:21 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:25:21 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:25:21 user nova-compute[74903]:   <serial>26d4864d-e556-43b9-9bf7-72f1befe5770</serial>
Nov 06 06:25:21 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:25:21 user nova-compute[74903]: </disk>
Nov 06 06:25:21 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:25:21 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully detached device vdb from instance bffa2829-0129-4874-b8a0-414651356cb8 from the persistent domain config.
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bffa2829-0129-4874-b8a0-414651356cb8 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:25:21 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:25:21 user nova-compute[74903]:   <source dev="/dev/sde"/>
Nov 06 06:25:21 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:25:21 user nova-compute[74903]:   <serial>26d4864d-e556-43b9-9bf7-72f1befe5770</serial>
Nov 06 06:25:21 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:25:21 user nova-compute[74903]: </disk>
Nov 06 06:25:21 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] Acquiring lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] Lock "e81183fa-470e-494d-9e07-c216b9a08e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] No waiting events found dispatching network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:21 user nova-compute[74903]: WARNING nova.compute.manager [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received unexpected event network-vif-plugged-2c405138-3e8e-4db3-afb3-06c8cd1122de for instance with vm_state deleted and task_state None.
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.compute.manager [req-0d186ecc-d608-49be-82f4-a9260931b353 req-844d3475-8a7d-446a-b2b2-ad08dcb0bac0 service nova] [instance: e81183fa-470e-494d-9e07-c216b9a08e6f] Received event network-vif-deleted-2c405138-3e8e-4db3-afb3-06c8cd1122de {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:25:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: INFO nova.compute.manager [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Unrescuing
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'flavor' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:24 user nova-compute[74903]: WARNING nova.compute.manager [req-a3bdee98-50d7-4bb6-ab93-c73d5a0adb42 req-ac83c7d1-9692-4010-9d97-4cf4b5906c50 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:25:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:25 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance destroyed successfully.
Nov 06 06:25:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing instance network info cache due to event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated VIF entry in instance network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:27 user nova-compute[74903]: WARNING nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing instance network info cache due to event network-changed-d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquiring lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquired lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Refreshing network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updated VIF entry in instance network info cache for port d4b76b36-9cc0-4275-8eb0-90d70d4a0940. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [{"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Releasing lock "refresh_cache-a0337bf8-e941-4b21-8b87-580831eec57f" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:27 user nova-compute[74903]: WARNING nova.compute.manager [req-620440aa-85a0-4f98-b629-4d9b5d99fb4f req-c9340dc8-6d64-4a55-a55c-57f5c2ed1436 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state rescued and task_state unrescuing.
Nov 06 06:25:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ad0541a4-7802-4d8f-b05d-c112ee7dd105 tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:25:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:29 user nova-compute[74903]: WARNING nova.compute.manager [req-f3345385-1c82-4869-ae7c-8dfc41f020f5 req-4a74f5e4-4786-4d3c-877a-55a38834b6a7 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state active and task_state None.
Nov 06 06:25:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:25:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:38 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:25:39 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:25:39 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=25.09117889404297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bffa2829-0129-4874-b8a0-414651356cb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance d5b15233-20c0-4717-b94f-ccb708c3fb09 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:25:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:40 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:25:40 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:25:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:25:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bffa2829-0129-4874-b8a0-414651356cb8 is timed out.
Nov 06 06:25:41 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully detached device vdb from instance bffa2829-0129-4874-b8a0-414651356cb8 from the live domain config.
Nov 06 06:25:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NPaMpVyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:25:41 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c04df-3c56-4189-9b38-ef4fdc64c44f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:25:41 user nova-compute[74903]: No targets found.
Nov 06 06:25:41 user nova-compute[74903]: iSNS:
Nov 06 06:25:41 user nova-compute[74903]: No targets found.
Nov 06 06:25:41 user nova-compute[74903]: STATIC:
Nov 06 06:25:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770
Nov 06 06:25:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:25:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:25:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:25:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:25:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:25:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1
Nov 06 06:25:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:25:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:25:41 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:25:41 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:25:41 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:25:41 user nova-compute[74903]: FIRMWARE:
Nov 06 06:25:41 user nova-compute[74903]: No targets found.
Nov 06 06:25:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:25:41 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:25:41 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4000fbd-8651-4225-8a65-56d0d94e7ffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c132b18a-4c34-4d84-bb17-c5b2e08addd3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:25:41 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa084903a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770'): ({'sde'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Removing single pathed devices sde {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7770f76-b204-417a-8b65-c8869d68bf49]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd368e2-3ecf-4658-a42b-7944154ae603]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Flushing IO for device /dev/sde {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[248dc3b8-8971-4cb5-86b8-798abea52a7c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[70485fe4-32fe-4df5-bd9c-b1abb33a8dd0]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] SCSI volumes sde have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:25:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d9143-f871-44ce-b6be-4fa6062c5bff]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f665961-d767-4a71-8ae9-8a09dec65328]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260]
Nov 06 06:25:42 user nova-compute[74903]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770, portal: 172.16.0.220,3260] successful.
Nov 06 06:25:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26d4864d-e556-43b9-9bf7-72f1befe5770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[087d7d46-c058-422e-bdd6-1b9245e91267]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] <== disconnect_volume: return (335ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:25:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:25:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'flavor' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3250d3bc-473d-4152-b547-912ae47bb7f8 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.046s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'info_cache' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.neutron [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:25:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance destroyed successfully.
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'resources' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG os_vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6531ffa-c3, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=699ef6aa-6b31-4e51-a2b8-5e5640f3fbb5) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:54 user nova-compute[74903]: INFO os_vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start _get_guest_xml network_info=[{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:25:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:25:54 user nova-compute[74903]:   <uuid>8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</uuid>
Nov 06 06:25:54 user nova-compute[74903]:   <name>instance-00000024</name>
Nov 06 06:25:54 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:25:54 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:25:54 user nova-compute[74903]:   <metadata>
Nov 06 06:25:54 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:25:54 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeTestJSON-server-534899196</nova:name>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:25:54</nova:creationTime>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:25:54 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:25:54 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:owner>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:user uuid="bd5ebd68316d430a86749b05b13ebf21">tempest-AttachVolumeTestJSON-2127223018-project-member</nova:user>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:project uuid="5f0ee9f9d310436fb18fb51fe1c2b3b0">tempest-AttachVolumeTestJSON-2127223018</nova:project>
Nov 06 06:25:54 user nova-compute[74903]:       </nova:owner>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:25:54 user nova-compute[74903]:       <nova:ports>
Nov 06 06:25:54 user nova-compute[74903]:         <nova:port uuid="f6531ffa-c360-4977-94ba-25ccf8e2474e">
Nov 06 06:25:54 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:25:54 user nova-compute[74903]:         </nova:port>
Nov 06 06:25:54 user nova-compute[74903]:       </nova:ports>
Nov 06 06:25:54 user nova-compute[74903]:     </nova:instance>
Nov 06 06:25:54 user nova-compute[74903]:   </metadata>
Nov 06 06:25:54 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:25:54 user nova-compute[74903]:     <system>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="serial">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="uuid">8d8c3ba8-856b-4e95-800d-7d4b8ab946fc</entry>
Nov 06 06:25:54 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:25:54 user nova-compute[74903]:     </system>
Nov 06 06:25:54 user nova-compute[74903]:   </sysinfo>
Nov 06 06:25:54 user nova-compute[74903]:   <os>
Nov 06 06:25:54 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:25:54 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:25:54 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:25:54 user nova-compute[74903]:   </os>
Nov 06 06:25:54 user nova-compute[74903]:   <features>
Nov 06 06:25:54 user nova-compute[74903]:     <acpi/>
Nov 06 06:25:54 user nova-compute[74903]:     <apic/>
Nov 06 06:25:54 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:25:54 user nova-compute[74903]:   </features>
Nov 06 06:25:54 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:25:54 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:25:54 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:25:54 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:25:54 user nova-compute[74903]:   </clock>
Nov 06 06:25:54 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:25:54 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:25:54 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:25:54 user nova-compute[74903]:   </cpu>
Nov 06 06:25:54 user nova-compute[74903]:   <devices>
Nov 06 06:25:54 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:25:54 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:25:54 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk"/>
Nov 06 06:25:54 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:25:54 user nova-compute[74903]:     </disk>
Nov 06 06:25:54 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:25:54 user nova-compute[74903]:       <mac address="fa:16:3e:58:e8:a8"/>
Nov 06 06:25:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:25:54 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:25:54 user nova-compute[74903]:       <target dev="tapf6531ffa-c3"/>
Nov 06 06:25:54 user nova-compute[74903]:     </interface>
Nov 06 06:25:54 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:25:54 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/console.log" append="off"/>
Nov 06 06:25:54 user nova-compute[74903]:     </serial>
Nov 06 06:25:54 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:25:54 user nova-compute[74903]:     <video>
Nov 06 06:25:54 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:25:54 user nova-compute[74903]:     </video>
Nov 06 06:25:54 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:25:54 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:25:54 user nova-compute[74903]:     </rng>
Nov 06 06:25:54 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:25:54 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:25:54 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:25:54 user nova-compute[74903]:     </memballoon>
Nov 06 06:25:54 user nova-compute[74903]:   </devices>
Nov 06 06:25:54 user nova-compute[74903]: </domain>
Nov 06 06:25:54 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:25:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Cannot resize image /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.objects.instance [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'migration_context' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.objects.base [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Object Instance<8d8c3ba8-856b-4e95-800d-7d4b8ab946fc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG os_vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27311ea9-d5bc-5ebe-893b-7d45b7a71a7b', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6531ffa-c3, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6531ffa-c3, col_values=(('qos', UUID('3a9a03f1-fbb2-4652-b7f8-93fbfadfddc8')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6531ffa-c3, col_values=(('external_ids', {'iface-id': 'f6531ffa-c360-4977-94ba-25ccf8e2474e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:e8:a8', 'vm-uuid': '8d8c3ba8-856b-4e95-800d-7d4b8ab946fc'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:25:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:55 user nova-compute[74903]: INFO os_vif [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:25:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:57 user nova-compute[74903]: WARNING nova.compute.manager [req-2f052d13-4009-483b-8ef3-3282ab4bd849 req-637eb5d9-a6af-4aca-8d30-dbc8a820962b service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state stopped and task_state powering-on.
Nov 06 06:25:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:57 user nova-compute[74903]: INFO nova.compute.manager [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Detaching volume e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:25:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: INFO nova.virt.block_device [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Attempting to driver detach volume e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 from mountpoint /dev/vdb
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Attempting to detach device vdb from instance a0337bf8-e941-4b21-8b87-580831eec57f from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:25:57 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:25:57 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:25:57 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:25:57 user nova-compute[74903]:   <serial>e0fa7f1f-4e9e-4a14-bea5-e564a1324d95</serial>
Nov 06 06:25:57 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:25:57 user nova-compute[74903]: </disk>
Nov 06 06:25:57 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:25:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Successfully detached device vdb from instance a0337bf8-e941-4b21-8b87-580831eec57f from the persistent domain config.
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0337bf8-e941-4b21-8b87-580831eec57f from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:25:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:25:57 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:25:57 user nova-compute[74903]:   <source dev="/dev/sdd"/>
Nov 06 06:25:57 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:25:57 user nova-compute[74903]:   <serial>e0fa7f1f-4e9e-4a14-bea5-e564a1324d95</serial>
Nov 06 06:25:57 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:25:57 user nova-compute[74903]: </disk>
Nov 06 06:25:57 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:25:58 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:25:59 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance rebooted successfully.
Nov 06 06:25:59 user nova-compute[74903]: DEBUG nova.compute.manager [None req-43e531eb-f9e2-4529-a569-fe2c76bae180 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:25:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:25:59 user nova-compute[74903]: WARNING nova.compute.manager [req-54ea19e2-24ea-477b-8857-03bb48f60442 req-bded5ec7-b963-4ac8-a266-268e0b516b0c service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state active and task_state None.
Nov 06 06:26:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-changed-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Refreshing instance network info cache due to event network-changed-6e97e520-4bf1-4f70-8778-463bf9733a5f. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:26:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] Acquiring lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:26:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] Acquired lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:26:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Refreshing network info cache for port 6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:09 user nova-compute[74903]: INFO nova.compute.manager [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Terminating instance
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.network.neutron [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updated VIF entry in instance network info cache for port 6e97e520-4bf1-4f70-8778-463bf9733a5f. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.network.neutron [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updating instance_info_cache with network_info: [{"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d2651383-1cdd-4ce3-becc-b59ca9518120 req-97813af5-aa07-465c-8023-c05a889f9bfd service nova] Releasing lock "refresh_cache-d5b15233-20c0-4717-b94f-ccb708c3fb09" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-412b3bf1-f197-4ccb-824c-c80afd5b4d82 req-7c3b1c65-5a89-4bbc-a51e-f12cc23e0afc service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Instance destroyed successfully.
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid d5b15233-20c0-4717-b94f-ccb708c3fb09 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:24:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1255349431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1255349431',id=42,image_ref='c4cc0c67-5343-42ff-8443-d57acdcb72e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA77xMna316gD79JXmvWmTrWmBCKXruvsIGF6ytAgNc0gd9YnQljAEnfDcQs3Ptie3G4XKlN2Hlb+TUWVHEgRfygaQRcdmxs/x6KpGVOvdPDf+HELCfxSNuUSzr9jkfHw==',key_name='tempest-keypair-1139854666',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:24:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-m88wq7oq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-251399615',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=d5b15233-20c0-4717-b94f-ccb708c3fb09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "address": "fa:16:3e:a1:13:64", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e97e520-4b", "ovs_interfaceid": "6e97e520-4bf1-4f70-8778-463bf9733a5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_vif [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e97e520-4b, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4cf6c41-1254-47f6-94a2-a9fdce8eb8cb) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: INFO os_vif [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:13:64,bridge_name='br-int',has_traffic_filtering=True,id=6e97e520-4bf1-4f70-8778-463bf9733a5f,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e97e520-4b')
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZeQfEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:26:10 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[551cee87-7071-4fa4-96ea-cbb5ffdd8576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:26:10 user nova-compute[74903]: No targets found.
Nov 06 06:26:10 user nova-compute[74903]: iSNS:
Nov 06 06:26:10 user nova-compute[74903]: No targets found.
Nov 06 06:26:10 user nova-compute[74903]: STATIC:
Nov 06 06:26:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:26:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:26:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:26:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1
Nov 06 06:26:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:26:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:26:10 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:26:10 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:26:10 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:26:10 user nova-compute[74903]: FIRMWARE:
Nov 06 06:26:10 user nova-compute[74903]: No targets found.
Nov 06 06:26:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:26:10 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:26:10 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eeeffa-d59c-4e88-a399-9b7f08100f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2736bb-f96d-4fb6-b9e5-3e1427622eb3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:26:10 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:26:10 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:26:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:26:10 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:26:10 user nova-compute[74903]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 (non-flash)
Nov 06 06:26:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08592b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1'): ({'sdg'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdg {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391c8e6-077e-4a97-8130-5303e7edf3b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5548e2d-dfce-4d49-8d5a-611eae554455]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdg {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a807d-90c3-4e16-98a1-52e516966b16]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f7e52-fdf8-4ad2-a18d-4e1f13576942]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdg have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[74496b97-c8be-4cb1-b1db-2ae34f42f292]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e9d3e-a77b-46f5-bd2e-fa6891f67edf]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260]
Nov 06 06:26:10 user nova-compute[74903]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1, portal: 172.16.0.220,3260] successful.
Nov 06 06:26:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b461dd-15a1-4ea1-ad51-99186bc5bbc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5273aa51-1abf-4dec-8812-86fba726853b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (341ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:26:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Deleting instance files /opt/stack/data/nova/instances/d5b15233-20c0-4717-b94f-ccb708c3fb09_del
Nov 06 06:26:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Deletion of /opt/stack/data/nova/instances/d5b15233-20c0-4717-b94f-ccb708c3fb09_del complete
Nov 06 06:26:10 user nova-compute[74903]: INFO nova.compute.manager [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 06 06:26:10 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:26:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:11 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Took 0.86 seconds to deallocate network for instance.
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-b9ce753c-f296-4750-bf23-93c8f7e30d21 req-107b192b-c8d1-4b06-b150-d7b30aa7af0c service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-deleted-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: INFO nova.compute.manager [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Terminating instance
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:11 user nova-compute[74903]: WARNING nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state active and task_state deleting.
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:11 user nova-compute[74903]: WARNING nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state active and task_state deleting.
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:11 user nova-compute[74903]: WARNING nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state active and task_state deleting.
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-unplugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Acquiring lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] No waiting events found dispatching network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:11 user nova-compute[74903]: WARNING nova.compute.manager [req-0c0273e9-ed41-49d2-b56a-f8ef55205338 req-9a8b008f-c5a0-40ed-95fb-32a1d02662ab service nova] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Received unexpected event network-vif-plugged-6e97e520-4bf1-4f70-8778-463bf9733a5f for instance with vm_state active and task_state deleting.
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Instance destroyed successfully.
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.objects.instance [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lazy-loading 'resources' on Instance uuid bffa2829-0129-4874-b8a0-414651356cb8 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-844307720',display_name='tempest-TestServerVolumeAttachmentScenario-server-844307720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-844307720',id=39,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwpAN9pLM+Af2MKo6PCnr75OlsCsUjEztWzNEEBhDz1eo2jbx0/59Nm0V1IMj7MTL4T66fTXo1ELpOpxFz7HJR1548A5gv5WQeT1ZAj5zUj08DPasWOhA7A3ya1gdB0JA==',key_name='tempest-keypair-535462748',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcdaeed567b049d4b154ad34788b564c',ramdisk_id='',reservation_id='r-4p76hug2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1695730784',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1695730784-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f68278436c824503a2c737b8ded10bc8',uuid=bffa2829-0129-4874-b8a0-414651356cb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converting VIF {"id": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "address": "fa:16:3e:6e:1c:04", "network": {"id": "b19f3ca6-f6c2-4436-88d8-550e2ccc47f6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1398276026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcdaeed567b049d4b154ad34788b564c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259a970a-b9", "ovs_interfaceid": "259a970a-b92b-4eb1-82a7-27d2377a65c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG os_vif [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap259a970a-b9, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5390407a-321d-4788-bb5c-6caac3a2b858) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:12 user nova-compute[74903]: INFO os_vif [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1c:04,bridge_name='br-int',has_traffic_filtering=True,id=259a970a-b92b-4eb1-82a7-27d2377a65c2,network=Network(b19f3ca6-f6c2-4436-88d8-550e2ccc47f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259a970a-b9')
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Deleting instance files /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8_del
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Deletion of /opt/stack/data/nova/instances/bffa2829-0129-4874-b8a0-414651356cb8_del complete
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.compute.manager [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 06 06:26:12 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.compute.manager [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Took 1.19 seconds to detach 1 volumes for instance.
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: d5b15233-20c0-4717-b94f-ccb708c3fb09] Deleting volume: 38b461dd-15a1-4ea1-ad51-99186bc5bbc1 {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:26:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:12 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance d5b15233-20c0-4717-b94f-ccb708c3fb09
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-18d2500d-8804-4d30-beb3-22ad43af6f84 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "d5b15233-20c0-4717-b94f-ccb708c3fb09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.759s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:13 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Took 0.83 seconds to deallocate network for instance.
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-vif-unplugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] No waiting events found dispatching network-vif-unplugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:13 user nova-compute[74903]: WARNING nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received unexpected event network-vif-unplugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 for instance with vm_state deleted and task_state None.
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Acquiring lock "bffa2829-0129-4874-b8a0-414651356cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] Lock "bffa2829-0129-4874-b8a0-414651356cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] No waiting events found dispatching network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:13 user nova-compute[74903]: WARNING nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received unexpected event network-vif-plugged-259a970a-b92b-4eb1-82a7-27d2377a65c2 for instance with vm_state deleted and task_state None.
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-3fa27d9f-2728-4431-9295-d4c5edc5089d req-a0f92e06-db71-4edb-8af6-5ceb825bd725 service nova] [instance: bffa2829-0129-4874-b8a0-414651356cb8] Received event network-vif-deleted-259a970a-b92b-4eb1-82a7-27d2377a65c2 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:13 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Deleted allocations for instance bffa2829-0129-4874-b8a0-414651356cb8
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-716a3453-738d-4f47-9dbd-dc791e5d3b14 tempest-TestServerVolumeAttachmentScenario-1695730784 tempest-TestServerVolumeAttachmentScenario-1695730784-project-member] Lock "bffa2829-0129-4874-b8a0-414651356cb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.186s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:26:13 user nova-compute[74903]: INFO nova.compute.claims [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Claim successful on node user
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:26:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.policy [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8673337612a54ca0a89d180a830cbaf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ac2801ad3f4b75bc98d85071d479c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:26:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Creating image(s)
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "/opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "/opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk 1073741824" returned: 0 in 0.049s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Successfully created port: 9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Cannot resize image /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Successfully updated port: 9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-changed-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.compute.manager [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Refreshing instance network info cache due to event network-changed-9e4407b6-55be-4f0a-a95e-0dfe580e8edd. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:26:15 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Instance network_info: |[{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Refreshing network info cache for port 9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Start _get_guest_xml network_info=[{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:26:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:26:16 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518849501',display_name='tempest-AttachVolumeNegativeTest-server-518849501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518849501',id=43,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg185ZfatERE6xbC+Q0GhaQ2HRDLF7EUHUbxejbzUiGbO4prP9XIsgstkzxVDXAn3q9Sn3CLd2Tr0cDXgx/cY3OKaty+MezdaVtxEH7wiQfXWSdXQrxZ85VsmE2dW8KEg==',key_name='tempest-keypair-1021199660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-vfbntvx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=d33ed773-a7e2-4b40-88ca-a27984d04d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'pci_devices' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:26:16 user nova-compute[74903]:   <uuid>d33ed773-a7e2-4b40-88ca-a27984d04d7e</uuid>
Nov 06 06:26:16 user nova-compute[74903]:   <name>instance-0000002b</name>
Nov 06 06:26:16 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:26:16 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:26:16 user nova-compute[74903]:   <metadata>
Nov 06 06:26:16 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:26:16 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeNegativeTest-server-518849501</nova:name>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:26:16</nova:creationTime>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:26:16 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:26:16 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:owner>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:user uuid="8673337612a54ca0a89d180a830cbaf5">tempest-AttachVolumeNegativeTest-1944196622-project-member</nova:user>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:project uuid="b9ac2801ad3f4b75bc98d85071d479c6">tempest-AttachVolumeNegativeTest-1944196622</nova:project>
Nov 06 06:26:16 user nova-compute[74903]:       </nova:owner>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:26:16 user nova-compute[74903]:       <nova:ports>
Nov 06 06:26:16 user nova-compute[74903]:         <nova:port uuid="9e4407b6-55be-4f0a-a95e-0dfe580e8edd">
Nov 06 06:26:16 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 06:26:16 user nova-compute[74903]:         </nova:port>
Nov 06 06:26:16 user nova-compute[74903]:       </nova:ports>
Nov 06 06:26:16 user nova-compute[74903]:     </nova:instance>
Nov 06 06:26:16 user nova-compute[74903]:   </metadata>
Nov 06 06:26:16 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:26:16 user nova-compute[74903]:     <system>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="serial">d33ed773-a7e2-4b40-88ca-a27984d04d7e</entry>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="uuid">d33ed773-a7e2-4b40-88ca-a27984d04d7e</entry>
Nov 06 06:26:16 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:26:16 user nova-compute[74903]:     </system>
Nov 06 06:26:16 user nova-compute[74903]:   </sysinfo>
Nov 06 06:26:16 user nova-compute[74903]:   <os>
Nov 06 06:26:16 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:26:16 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:26:16 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:26:16 user nova-compute[74903]:   </os>
Nov 06 06:26:16 user nova-compute[74903]:   <features>
Nov 06 06:26:16 user nova-compute[74903]:     <acpi/>
Nov 06 06:26:16 user nova-compute[74903]:     <apic/>
Nov 06 06:26:16 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:26:16 user nova-compute[74903]:   </features>
Nov 06 06:26:16 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:26:16 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:26:16 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:26:16 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:26:16 user nova-compute[74903]:   </clock>
Nov 06 06:26:16 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:26:16 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:26:16 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:26:16 user nova-compute[74903]:   </cpu>
Nov 06 06:26:16 user nova-compute[74903]:   <devices>
Nov 06 06:26:16 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:26:16 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:26:16 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk"/>
Nov 06 06:26:16 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:26:16 user nova-compute[74903]:     </disk>
Nov 06 06:26:16 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:26:16 user nova-compute[74903]:       <mac address="fa:16:3e:d3:8f:c1"/>
Nov 06 06:26:16 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:26:16 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:26:16 user nova-compute[74903]:       <target dev="tap9e4407b6-55"/>
Nov 06 06:26:16 user nova-compute[74903]:     </interface>
Nov 06 06:26:16 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:26:16 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/console.log" append="off"/>
Nov 06 06:26:16 user nova-compute[74903]:     </serial>
Nov 06 06:26:16 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:26:16 user nova-compute[74903]:     <video>
Nov 06 06:26:16 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:26:16 user nova-compute[74903]:     </video>
Nov 06 06:26:16 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:26:16 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:26:16 user nova-compute[74903]:     </rng>
Nov 06 06:26:16 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:26:16 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:26:16 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:26:16 user nova-compute[74903]:     </memballoon>
Nov 06 06:26:16 user nova-compute[74903]:   </devices>
Nov 06 06:26:16 user nova-compute[74903]: </domain>
Nov 06 06:26:16 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518849501',display_name='tempest-AttachVolumeNegativeTest-server-518849501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518849501',id=43,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg185ZfatERE6xbC+Q0GhaQ2HRDLF7EUHUbxejbzUiGbO4prP9XIsgstkzxVDXAn3q9Sn3CLd2Tr0cDXgx/cY3OKaty+MezdaVtxEH7wiQfXWSdXQrxZ85VsmE2dW8KEg==',key_name='tempest-keypair-1021199660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-vfbntvx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=d33ed773-a7e2-4b40-88ca-a27984d04d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG os_vif [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53877cf-d4fb-5dbb-b6b6-f830469410cf', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e4407b6-55, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e4407b6-55, col_values=(('qos', UUID('d0816bce-5246-458b-a289-c2a6690c3ad8')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e4407b6-55, col_values=(('external_ids', {'iface-id': '9e4407b6-55be-4f0a-a95e-0dfe580e8edd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:8f:c1', 'vm-uuid': 'd33ed773-a7e2-4b40-88ca-a27984d04d7e'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:16 user nova-compute[74903]: INFO os_vif [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55')
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:d3:8f:c1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updated VIF entry in instance network info cache for port 9e4407b6-55be-4f0a-a95e-0dfe580e8edd. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-254f2a21-195b-42c5-872a-01720858f481 req-72226e9b-e6c3-427b-8518-31a0e274a77f service nova] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:26:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:18 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0337bf8-e941-4b21-8b87-580831eec57f is timed out.
Nov 06 06:26:18 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Successfully detached device vdb from instance a0337bf8-e941-4b21-8b87-580831eec57f from the live domain config.
Nov 06 06:26:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MldWvFCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:26:18 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68043bb-3c0f-461a-ab24-38cfad1fb537]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:26:18 user nova-compute[74903]: No targets found.
Nov 06 06:26:18 user nova-compute[74903]: iSNS:
Nov 06 06:26:18 user nova-compute[74903]: No targets found.
Nov 06 06:26:18 user nova-compute[74903]: STATIC:
Nov 06 06:26:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:26:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:26:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:26:18 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95
Nov 06 06:26:18 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:26:18 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:26:18 user nova-compute[74903]: FIRMWARE:
Nov 06 06:26:18 user nova-compute[74903]: No targets found.
Nov 06 06:26:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:26:18 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:26:18 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14c2c3-4e82-46af-a318-f94f72bde922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] No waiting events found dispatching network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:18 user nova-compute[74903]: WARNING nova.compute.manager [req-174cf535-47fa-490c-b841-4aec2318c723 req-6f980f61-c9b8-48bd-b352-80e2a3fe7c9e service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received unexpected event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd for instance with vm_state building and task_state spawning.
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[de545243-63a7-44bc-a79e-0e112edb89ba]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:26:18 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:26:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:26:18 user nova-compute[74903]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 (non-flash)
Nov 06 06:26:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28652680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d504cf-bc41-4313-b6ee-a550bdaf7ace]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e842dc74-31d4-4302-b482-17a796c850e6]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf57ae-78e0-4f7a-a117-634be17d6fdd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c787711c-1625-4f57-8448-ef0780f81bfc]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb02c28-06c7-4e54-bf31-77290fe48d9a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3605c1c-9ce8-43a8-a38c-6090dc2b7189]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260]
Nov 06 06:26:18 user nova-compute[74903]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95, portal: 172.16.0.220,3260] successful.
Nov 06 06:26:18 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fa7f1f-4e9e-4a14-bea5-e564a1324d95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[99389e46-a1d4-4390-ab44-33d0edc753fd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] <== disconnect_volume: return (368ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'flavor' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0e556fbe-72dc-4526-a09d-fe87766f7fdd tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:26:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Instance spawned successfully.
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:26:20 user nova-compute[74903]: INFO nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] No waiting events found dispatching network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:20 user nova-compute[74903]: WARNING nova.compute.manager [req-d801d6bc-ad55-4307-812f-79a022f29962 req-2b055d9a-4645-4856-a6a8-4121ba02d072 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received unexpected event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd for instance with vm_state building and task_state spawning.
Nov 06 06:26:20 user nova-compute[74903]: INFO nova.compute.manager [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Took 6.32 seconds to build instance.
Nov 06 06:26:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c121c9be-ccc2-4594-b78e-e8baa3b22257 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.536s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [{"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:26:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:26:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:26:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:39 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:26:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:26:40 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8369MB free_disk=25.081283569335938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance a0337bf8-e941-4b21-8b87-580831eec57f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance d33ed773-a7e2-4b40-88ca-a27984d04d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:26:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:26:41 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:26:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:26:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:26:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:48 user nova-compute[74903]: INFO nova.compute.manager [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Terminating instance
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-f9deb6fb-8650-4be5-a906-25eef46cc6e1 req-9cbe4c32-199e-4da8-94d0-36b0177a9ecc service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Instance destroyed successfully.
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lazy-loading 'resources' on Instance uuid a0337bf8-e941-4b21-8b87-580831eec57f {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1987042337',display_name='tempest-ServerStableDeviceRescueTest-server-1987042337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1987042337',id=38,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByt1pI2/SsEmmqiAssLT6BTfxA6sUPgigNIlwoLXLrehdOwXtEaY/YlVx5Z+rVvkv+ALYzCRWIBn9D+0jBeFKyO1FN9d56SJpxDf9WBOi1GbRESgsFeGLYNtfrM2SxXqg==',key_name='tempest-keypair-1589938492',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1b5857e46dc41849562a385ea14ff4e',ramdisk_id='',reservation_id='r-zpjznmfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-263532306',owner_user_name='tempest-ServerStableDeviceRescueTest-263532306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:25:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='464230a135f94828b7f04a9bf10a3ab4',uuid=a0337bf8-e941-4b21-8b87-580831eec57f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converting VIF {"id": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "address": "fa:16:3e:d7:93:9e", "network": {"id": "989e0301-e1e8-4fae-b3ba-9e9338bbd8bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-839798458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1b5857e46dc41849562a385ea14ff4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4b76b36-9c", "ovs_interfaceid": "d4b76b36-9cc0-4275-8eb0-90d70d4a0940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG os_vif [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4b76b36-9c, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca8d2863-c27e-4273-9f0f-b76f32fce0d3) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:48 user nova-compute[74903]: INFO os_vif [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:93:9e,bridge_name='br-int',has_traffic_filtering=True,id=d4b76b36-9cc0-4275-8eb0-90d70d4a0940,network=Network(989e0301-e1e8-4fae-b3ba-9e9338bbd8bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4b76b36-9c')
Nov 06 06:26:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Deleting instance files /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f_del
Nov 06 06:26:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Deletion of /opt/stack/data/nova/instances/a0337bf8-e941-4b21-8b87-580831eec57f_del complete
Nov 06 06:26:48 user nova-compute[74903]: INFO nova.compute.manager [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 06:26:48 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:26:48 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:26:49 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Took 0.83 seconds to deallocate network for instance.
Nov 06 06:26:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-d0698975-b1a3-456b-921e-ac19a005f21a req-ae0e3698-d166-4717-b3a5-d37e30438a75 service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-deleted-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:26:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Deleted allocations for instance a0337bf8-e941-4b21-8b87-580831eec57f
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6044647a-14a0-4c25-ab10-26ea8adee7ed tempest-ServerStableDeviceRescueTest-263532306 tempest-ServerStableDeviceRescueTest-263532306-project-member] Lock "a0337bf8-e941-4b21-8b87-580831eec57f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:50 user nova-compute[74903]: WARNING nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state deleted and task_state None.
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:50 user nova-compute[74903]: WARNING nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state deleted and task_state None.
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:50 user nova-compute[74903]: WARNING nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state deleted and task_state None.
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:50 user nova-compute[74903]: WARNING nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-unplugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state deleted and task_state None.
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Acquiring lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] Lock "a0337bf8-e941-4b21-8b87-580831eec57f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:26:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] No waiting events found dispatching network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:26:50 user nova-compute[74903]: WARNING nova.compute.manager [req-ade8a00e-6b2a-40bc-9a26-697e4d2449f3 req-b3152851-5269-4d4d-a2ca-bba9687d7b6b service nova] [instance: a0337bf8-e941-4b21-8b87-580831eec57f] Received unexpected event network-vif-plugged-d4b76b36-9cc0-4275-8eb0-90d70d4a0940 for instance with vm_state deleted and task_state None.
Nov 06 06:26:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:26:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:26:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:55 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:26:55 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:26:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:27:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:11 user nova-compute[74903]: INFO nova.compute.manager [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Terminating instance
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.compute.manager [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-4a85fb93-817a-42a0-a4fe-194c310de9d2 req-16e1d3e0-8a84-4961-93f1-84f05e1d8c48 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Instance destroyed successfully.
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.objects.instance [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-363128844',display_name='tempest-TestVolumeBootPattern-volume-backed-server-363128844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-363128844',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnUw8ND3xyvkI39tHP8/AqFDCU0PeT9tCXS0Q2p6tbNbRsbpW3EJW1RL2srVQdRxEJNiIu5VMUOMKcosqh4sw1Ob80kwDdIyry54Ui2DuW6/VcffTIS0GUAANR93YbFvw==',key_name='tempest-keypair-443376449',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-qqvraou9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e598c1904d5b476098cfa01d389dd816',uuid=9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "05a265bf-97f2-4d18-9279-f3387e145df1", "address": "fa:16:3e:ad:01:c3", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a265bf-97", "ovs_interfaceid": "05a265bf-97f2-4d18-9279-f3387e145df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG os_vif [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a265bf-97, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3c299be-d80d-4a1e-9026-d3010345765a) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: INFO os_vif [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=05a265bf-97f2-4d18-9279-f3387e145df1,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a265bf-97')
Nov 06 06:27:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmcbdVUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:27:12 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5611e7ca-77f1-4579-b50a-e9a53c38b101]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:27:12 user nova-compute[74903]: No targets found.
Nov 06 06:27:12 user nova-compute[74903]: iSNS:
Nov 06 06:27:12 user nova-compute[74903]: No targets found.
Nov 06 06:27:12 user nova-compute[74903]: STATIC:
Nov 06 06:27:12 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee
Nov 06 06:27:12 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:27:12 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:27:12 user nova-compute[74903]: FIRMWARE:
Nov 06 06:27:12 user nova-compute[74903]: No targets found.
Nov 06 06:27:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:27:12 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:27:12 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73fab16-68be-4338-942a-4b1658f078d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d3afe9-1be3-4d64-96b5-817bc3d45367]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:27:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee (non-flash)
Nov 06 06:27:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4033ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf1a6ef-a461-4374-8b2d-d69bdee38586]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b0899-9672-4d92-b34e-c3d0817f5f81]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64c7fcb-3766-4a57-a8c5-3ece4972631b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29a3449-d899-4369-9d9f-ce18415d4664]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cbd4e43',) {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:27:12 user nova-compute[74903]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_cbd4e43
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6b7e2-4879-4a1c-90b8-a097bf6da0fc]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede7871-3a0d-49f2-ab48-09b343c0284b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f0eef-f34e-48e0-b8f2-59b10d5b29b8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260]
Nov 06 06:27:12 user nova-compute[74903]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee, portal: 172.16.0.220,3260] successful.
Nov 06 06:27:12 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:559e3cfb-cab5-41aa-9969-a3f7584acfee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[672950af-ac6d-49af-b4ee-90779193914d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (327ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:27:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Deleting instance files /opt/stack/data/nova/instances/9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e_del
Nov 06 06:27:12 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Deletion of /opt/stack/data/nova/instances/9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e_del complete
Nov 06 06:27:12 user nova-compute[74903]: INFO nova.compute.manager [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 06 06:27:12 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:27:13 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Took 0.93 seconds to deallocate network for instance.
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:13 user nova-compute[74903]: WARNING nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state active and task_state deleting.
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:13 user nova-compute[74903]: WARNING nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state active and task_state deleting.
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:13 user nova-compute[74903]: WARNING nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state active and task_state deleting.
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-unplugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Acquiring lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] No waiting events found dispatching network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:13 user nova-compute[74903]: WARNING nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received unexpected event network-vif-plugged-05a265bf-97f2-4d18-9279-f3387e145df1 for instance with vm_state active and task_state deleting.
Nov 06 06:27:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-e12284d2-68d3-4387-85cb-21e92d42ea90 req-6770940e-a7f0-4362-82b1-52d263161e50 service nova] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Received event network-vif-deleted-05a265bf-97f2-4d18-9279-f3387e145df1 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:14 user nova-compute[74903]: INFO nova.compute.manager [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Took 0.85 seconds to detach 1 volumes for instance.
Nov 06 06:27:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e] Deleting volume: 559e3cfb-cab5-41aa-9969-a3f7584acfee {{(pid=74903) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 06:27:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:14 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:27:14 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:27:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:14 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance 9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e
Nov 06 06:27:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cb6fbeaf-e7a5-499d-8208-917cbe804b65 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "9b7a4cd3-3eb3-48bc-9ae4-2060ae26d55e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.436s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:27:29 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:33 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:27:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:27:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:27:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:27:41 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.20309829711914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance d33ed773-a7e2-4b40-88ca-a27984d04d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:27:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:45 user nova-compute[74903]: INFO nova.compute.manager [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Terminating instance
Nov 06 06:27:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-894c3f5b-cafe-422b-9c46-1613ecceeca0 req-f0394ae0-a72c-4dda-81fc-41ae8326d49e service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-unplugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:27:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Instance destroyed successfully.
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.objects.instance [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'resources' on Instance uuid 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-534899196',display_name='tempest-AttachVolumeTestJSON-server-534899196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-534899196',id=36,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz/KNn66PoMMPqO5s7VDxeSEabcFjHCi9rGIcHL3pgqtiqA3QsBhn/ZkDhq6mw3ckLeYzEwOmnBNGJUfdhsMJXrv2vtiPyXlJ4VCHEN6AfnKnCsuKP4oSH5PA8cElUDkg==',key_name='tempest-keypair-604340',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-dhsk8p8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=8d8c3ba8-856b-4e95-800d-7d4b8ab946fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "address": "fa:16:3e:58:e8:a8", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6531ffa-c3", "ovs_interfaceid": "f6531ffa-c360-4977-94ba-25ccf8e2474e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG os_vif [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6531ffa-c3, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a9a03f1-fbb2-4652-b7f8-93fbfadfddc8) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:46 user nova-compute[74903]: INFO os_vif [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:e8:a8,bridge_name='br-int',has_traffic_filtering=True,id=f6531ffa-c360-4977-94ba-25ccf8e2474e,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6531ffa-c3')
Nov 06 06:27:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Deleting instance files /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc_del
Nov 06 06:27:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Deletion of /opt/stack/data/nova/instances/8d8c3ba8-856b-4e95-800d-7d4b8ab946fc_del complete
Nov 06 06:27:46 user nova-compute[74903]: INFO nova.compute.manager [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 06:27:46 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:27:46 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-f7203232-fc81-4442-b89b-e1f43deb1e15 req-337a5f09-2665-4b71-9165-e16249020485 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-deleted-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:47 user nova-compute[74903]: INFO nova.compute.manager [req-f7203232-fc81-4442-b89b-e1f43deb1e15 req-337a5f09-2665-4b71-9165-e16249020485 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Neutron deleted interface f6531ffa-c360-4977-94ba-25ccf8e2474e; detaching it from the instance and deleting it from the info cache
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.network.neutron [req-f7203232-fc81-4442-b89b-e1f43deb1e15 req-337a5f09-2665-4b71-9165-e16249020485 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:27:47 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Took 0.71 seconds to deallocate network for instance.
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.compute.manager [req-f7203232-fc81-4442-b89b-e1f43deb1e15 req-337a5f09-2665-4b71-9165-e16249020485 service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Detach interface failed, port_id=f6531ffa-c360-4977-94ba-25ccf8e2474e, reason: Instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:27:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:47 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Deleted allocations for instance 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc
Nov 06 06:27:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-4e77be14-2f88-47c3-af36-4a8f775b9412 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:27:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] Acquiring lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:27:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:27:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] Lock "8d8c3ba8-856b-4e95-800d-7d4b8ab946fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:27:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] No waiting events found dispatching network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:27:48 user nova-compute[74903]: WARNING nova.compute.manager [req-9ee69c4c-3333-4c00-9e27-67af82875baf req-0e5d6d4f-0e2e-44a5-a973-e00c66eb3c3f service nova] [instance: 8d8c3ba8-856b-4e95-800d-7d4b8ab946fc] Received unexpected event network-vif-plugged-f6531ffa-c360-4977-94ba-25ccf8e2474e for instance with vm_state deleted and task_state None.
Nov 06 06:27:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:27:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-changed-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Refreshing instance network info cache due to event network-changed-9e4407b6-55be-4f0a-a95e-0dfe580e8edd. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:28:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Refreshing network info cache for port 9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:28:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updated VIF entry in instance network info cache for port 9e4407b6-55be-4f0a-a95e-0dfe580e8edd. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:28:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2133ca5a-e49e-45d3-823f-ce2720bc6cdc req-c16a0e7e-c2f4-40e2-8f75-5894c78c3d57 service nova] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:10 user nova-compute[74903]: INFO nova.compute.manager [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Attaching volume 3b8f35d5-109f-47e6-9fbd-75ce1390787b to /dev/vdb
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.utils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e17b1-fce0-4b7f-8d25-de50f77d26ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664b8cb-6c51-446a-8fbd-0e8e1c86ef19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb0b8c-6ea5-4e79-a13b-8fa04f8a99ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91cf89-d4cf-45e4-9b97-e7a48ce9c4d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:28:10 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:28:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0562edce-f301-495f-b789-0d8b578f1a37]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG os_brick.utils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:28:10 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating existing volume attachment record: 9cca9291-aad7-4adb-8b93-7a4781063cce {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:28:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:21 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:28:21 user nova-compute[74903]: INFO nova.compute.claims [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Claim successful on node user
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:28:22 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:28:22 user nova-compute[74903]: INFO nova.virt.block_device [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Booting with volume a8822c4f-27ad-4fef-b9ef-c869438e2838 at /dev/vda
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.policy [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.utils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e57e259-81a9-4298-b62f-d6d518d4c6db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5adfe8-a59b-4ac1-8f54-cc40804f7b91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d23cf4-8cbe-4f1f-89fa-11a820011d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f46df0-b58b-48ee-9a2d-fc559b1d2f98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:28:22 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:28:22 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ecaf2-0a36-45c1-a70e-835e5ba23938]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG os_brick.utils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:28:22 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating existing volume attachment record: a1823697-3c87-4ac4-9289-3d5b8d0b94d3 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Successfully created port: d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Successfully updated port: d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-changed-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.compute.manager [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Refreshing instance network info cache due to event network-changed-d48a71a1-7745-4f3d-944b-8f483a4d831d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] Acquiring lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:23 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG nova.network.neutron [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating instance_info_cache with network_info: [{"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Instance network_info: |[{"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] Acquired lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Refreshing network info cache for port d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updated VIF entry in instance network info cache for port d48a71a1-7745-4f3d-944b-8f483a4d831d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG nova.network.neutron [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating instance_info_cache with network_info: [{"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-20a6f8db-2f0d-4389-9f2f-4a71ee933255 req-c3a0f8b7-91db-456d-8a60-04c30f1688ff service nova] Releasing lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Skipping network cache update for instance because it is Building. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:28:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:28:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:39 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:28:39 user nova-compute[74903]: INFO nova.compute.claims [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Claim successful on node user
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:28:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.policy [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5ebd68316d430a86749b05b13ebf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0ee9f9d310436fb18fb51fe1c2b3b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:28:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Creating image(s)
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "/opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "/opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "/opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk 1073741824" returned: 0 in 0.055s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Successfully created port: d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Cannot resize image /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Ensure instance console log exists: /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Successfully updated port: d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-changed-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.compute.manager [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Refreshing instance network info cache due to event network-changed-d9f47457-fc41-4063-9b43-f72570c491dd. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] Acquiring lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] Acquired lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.network.neutron [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Refreshing network info cache for port d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG nova.network.neutron [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:28:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.neutron [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvakjfEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:28:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:28:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:28:42 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8e89aa75-a45f-46dc-a7a9-609fc740461e req-8e64e3e3-a404-44d5-b58f-9c027f1cf0d4 service nova] Releasing lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquired lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:28:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.218673706054688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e7e28-ae1c-421f-91fb-765aa35fccb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:28:42 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee20bb47-55fc-4828-81b5-1c5beac3360a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b] added
Nov 06 06:28:42 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd710c-1512-48eb-9e85-1e61748de37b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance d33ed773-a7e2-4b40-88ca-a27984d04d7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 64cdf53e-7217-41a8-9fab-773432e1f9f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 11a2c3e4-7008-40c1-846c-55aad9073cbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af2f2c-161b-4c4b-887c-0308a52d5c6d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvakjfEi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvakjfEi" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f1faae-932c-4128-b044-093ca97564d6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvakjfEi'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8246aff-632d-449a-810a-f348170ff8c5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5aef34-00b4-4402-a915-437a35893330]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:28:42 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:28:42 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:28:42 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:28:42 user nova-compute[74903]: 
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Releasing lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance network_info: |[{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Start _get_guest_xml network_info=[{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:28:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121773370',display_name='tempest-AttachVolumeTestJSON-server-1121773370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121773370',id=45,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGEElHag93cZqlM6jlLXu7Gxf594B81BvaG7uisco20/szuPE4S7ZzMy1BlCLOFBroCzqZHdzEQ6nGsvCOLaDvVEBQj1f0I5sBkoDUr/weISCzXkZJyJ9G3pM1aDqxbkw==',key_name='tempest-keypair-1738985970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-mtcckj0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=11a2c3e4-7008-40c1-846c-55aad9073cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'pci_devices' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:28:42 user nova-compute[74903]:   <uuid>11a2c3e4-7008-40c1-846c-55aad9073cbb</uuid>
Nov 06 06:28:42 user nova-compute[74903]:   <name>instance-0000002d</name>
Nov 06 06:28:42 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:28:42 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:28:42 user nova-compute[74903]:   <metadata>
Nov 06 06:28:42 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:28:42 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:name>tempest-AttachVolumeTestJSON-server-1121773370</nova:name>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:28:42</nova:creationTime>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:28:42 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:28:42 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:owner>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:user uuid="bd5ebd68316d430a86749b05b13ebf21">tempest-AttachVolumeTestJSON-2127223018-project-member</nova:user>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:project uuid="5f0ee9f9d310436fb18fb51fe1c2b3b0">tempest-AttachVolumeTestJSON-2127223018</nova:project>
Nov 06 06:28:42 user nova-compute[74903]:       </nova:owner>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:28:42 user nova-compute[74903]:       <nova:ports>
Nov 06 06:28:42 user nova-compute[74903]:         <nova:port uuid="d9f47457-fc41-4063-9b43-f72570c491dd">
Nov 06 06:28:42 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 06:28:42 user nova-compute[74903]:         </nova:port>
Nov 06 06:28:42 user nova-compute[74903]:       </nova:ports>
Nov 06 06:28:42 user nova-compute[74903]:     </nova:instance>
Nov 06 06:28:42 user nova-compute[74903]:   </metadata>
Nov 06 06:28:42 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:28:42 user nova-compute[74903]:     <system>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="serial">11a2c3e4-7008-40c1-846c-55aad9073cbb</entry>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="uuid">11a2c3e4-7008-40c1-846c-55aad9073cbb</entry>
Nov 06 06:28:42 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:28:42 user nova-compute[74903]:     </system>
Nov 06 06:28:42 user nova-compute[74903]:   </sysinfo>
Nov 06 06:28:42 user nova-compute[74903]:   <os>
Nov 06 06:28:42 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:28:42 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:28:42 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:28:42 user nova-compute[74903]:   </os>
Nov 06 06:28:42 user nova-compute[74903]:   <features>
Nov 06 06:28:42 user nova-compute[74903]:     <acpi/>
Nov 06 06:28:42 user nova-compute[74903]:     <apic/>
Nov 06 06:28:42 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:28:42 user nova-compute[74903]:   </features>
Nov 06 06:28:42 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:28:42 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:28:42 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:28:42 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:28:42 user nova-compute[74903]:   </clock>
Nov 06 06:28:42 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:28:42 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:28:42 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:28:42 user nova-compute[74903]:   </cpu>
Nov 06 06:28:42 user nova-compute[74903]:   <devices>
Nov 06 06:28:42 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:28:42 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:28:42 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk"/>
Nov 06 06:28:42 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:28:42 user nova-compute[74903]:     </disk>
Nov 06 06:28:42 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:28:42 user nova-compute[74903]:       <mac address="fa:16:3e:13:a6:9d"/>
Nov 06 06:28:42 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:28:42 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:28:42 user nova-compute[74903]:       <target dev="tapd9f47457-fc"/>
Nov 06 06:28:42 user nova-compute[74903]:     </interface>
Nov 06 06:28:42 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:28:42 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/console.log" append="off"/>
Nov 06 06:28:42 user nova-compute[74903]:     </serial>
Nov 06 06:28:42 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:28:42 user nova-compute[74903]:     <video>
Nov 06 06:28:42 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:28:42 user nova-compute[74903]:     </video>
Nov 06 06:28:42 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:28:42 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:28:42 user nova-compute[74903]:     </rng>
Nov 06 06:28:42 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:28:42 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:28:42 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:28:42 user nova-compute[74903]:     </memballoon>
Nov 06 06:28:42 user nova-compute[74903]:   </devices>
Nov 06 06:28:42 user nova-compute[74903]: </domain>
Nov 06 06:28:42 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121773370',display_name='tempest-AttachVolumeTestJSON-server-1121773370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121773370',id=45,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGEElHag93cZqlM6jlLXu7Gxf594B81BvaG7uisco20/szuPE4S7ZzMy1BlCLOFBroCzqZHdzEQ6nGsvCOLaDvVEBQj1f0I5sBkoDUr/weISCzXkZJyJ9G3pM1aDqxbkw==',key_name='tempest-keypair-1738985970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-mtcckj0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=11a2c3e4-7008-40c1-846c-55aad9073cbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG os_vif [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c0b1e48-196a-5323-8ee2-cdf5ccdc6817', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9f47457-fc, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9f47457-fc, col_values=(('qos', UUID('e461e776-712e-44cb-96b0-f05b240e7c2f')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9f47457-fc, col_values=(('external_ids', {'iface-id': 'd9f47457-fc41-4063-9b43-f72570c491dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a6:9d', 'vm-uuid': '11a2c3e4-7008-40c1-846c-55aad9073cbb'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:42 user nova-compute[74903]: INFO os_vif [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc')
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:28:42 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No VIF found with MAC fa:16:3e:13:a6:9d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --login" returned: 0 in 1.068s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba304d63-9f56-4027-8dee-194cc676dd6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260]
Nov 06 06:28:43 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260] successful.
Nov 06 06:28:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d14c1-568e-4f38-ab54-406c5e0bcba3]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e0c59-a6e7-42a6-910c-f61551b3fe9b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.311s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a2d6f-db17-4989-b9f4-62df46a5c768]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:43 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvakjfEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.345s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== connect_volume: return (2348ms) {'type': 'block', 'scsi_wwn': '23738316461306233', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738316461306233', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:28:44 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:28:44 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:28:44 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:28:44 user nova-compute[74903]:   <serial>3b8f35d5-109f-47e6-9fbd-75ce1390787b</serial>
Nov 06 06:28:44 user nova-compute[74903]: </disk>
Nov 06 06:28:44 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] No waiting events found dispatching network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:28:44 user nova-compute[74903]: WARNING nova.compute.manager [req-788731d9-78b9-40d4-b90b-96e6301e9511 req-1495019a-9c54-46e9-8e5c-6ff9806c7ecc service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received unexpected event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd for instance with vm_state building and task_state spawning.
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:28:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Creating image(s)
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Ensure instance console log exists: /opt/stack/data/nova/instances/64cdf53e-7217-41a8-9fab-773432e1f9f1/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Start _get_guest_xml network_info=[{"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64cdf53e-7217-41a8-9fab-773432e1f9f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8822c4f-27ad-4fef-b9ef-c869438e2838', 'serial': 'a8822c4f-27ad-4fef-b9ef-c869438e2838'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'a1823697-3c87-4ac4-9289-3d5b8d0b94d3', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:28:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:28:44 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:28:44 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:28:44 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:28:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ec36d-9b40-482b-b1e1-4dffff406b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:28:44 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6491e5e-434f-4ae3-ad98-bff9e8f1fec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838] added
Nov 06 06:28:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6336df93-d1aa-46c4-bacb-1ec602e69aa9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e1d7b1-3f24-4f33-9519-558256c88207]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLzqocDb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLzqocDb" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35fb99f-6453-4ba9-aba8-2f388d11a71c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lLzqocDb'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c33d4fb-6f30-4939-b4ea-0ffee5a007ca]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] No VIF found with MAC fa:16:3e:d3:8f:c1, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[11765121-bdf1-4da5-b129-8690f2f9414d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:45 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:45 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b81902-ee67-4ece-a6f1-a734a894f6ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]
Nov 06 06:28:45 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.
Nov 06 06:28:45 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07b24f5-2520-488c-91dd-6c0e7a891956]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a99a7ec-5455-405a-848e-757ae3d232be]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:45 user nova-compute[74903]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:28:45 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:28:45 user nova-compute[74903]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:28:45 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ea823d22-02c6-4656-92aa-39ea16ace6b0 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.540s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[53190433-83f0-49c6-9910-9d3bd09ca9b4]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:28:45 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26263333034343236', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263333034343236', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1267869909',display_name='tempest-TestVolumeBootPattern-server-1267869909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1267869909',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-40tl09eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:28:22Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=64cdf53e-7217-41a8-9fab-773432e1f9f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid 64cdf53e-7217-41a8-9fab-773432e1f9f1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:28:46 user nova-compute[74903]:   <uuid>64cdf53e-7217-41a8-9fab-773432e1f9f1</uuid>
Nov 06 06:28:46 user nova-compute[74903]:   <name>instance-0000002c</name>
Nov 06 06:28:46 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:28:46 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:28:46 user nova-compute[74903]:   <metadata>
Nov 06 06:28:46 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:28:46 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:28:46 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-server-1267869909</nova:name>
Nov 06 06:28:46 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:28:44</nova:creationTime>
Nov 06 06:28:46 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:28:46 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:28:46 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:28:46 user nova-compute[74903]:       <nova:owner>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:28:46 user nova-compute[74903]:       </nova:owner>
Nov 06 06:28:46 user nova-compute[74903]:       <nova:ports>
Nov 06 06:28:46 user nova-compute[74903]:         <nova:port uuid="d48a71a1-7745-4f3d-944b-8f483a4d831d">
Nov 06 06:28:46 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 06:28:46 user nova-compute[74903]:         </nova:port>
Nov 06 06:28:46 user nova-compute[74903]:       </nova:ports>
Nov 06 06:28:46 user nova-compute[74903]:     </nova:instance>
Nov 06 06:28:46 user nova-compute[74903]:   </metadata>
Nov 06 06:28:46 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:28:46 user nova-compute[74903]:     <system>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="serial">64cdf53e-7217-41a8-9fab-773432e1f9f1</entry>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="uuid">64cdf53e-7217-41a8-9fab-773432e1f9f1</entry>
Nov 06 06:28:46 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:28:46 user nova-compute[74903]:     </system>
Nov 06 06:28:46 user nova-compute[74903]:   </sysinfo>
Nov 06 06:28:46 user nova-compute[74903]:   <os>
Nov 06 06:28:46 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:28:46 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:28:46 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:28:46 user nova-compute[74903]:   </os>
Nov 06 06:28:46 user nova-compute[74903]:   <features>
Nov 06 06:28:46 user nova-compute[74903]:     <acpi/>
Nov 06 06:28:46 user nova-compute[74903]:     <apic/>
Nov 06 06:28:46 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:28:46 user nova-compute[74903]:   </features>
Nov 06 06:28:46 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:28:46 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:28:46 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:28:46 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:28:46 user nova-compute[74903]:   </clock>
Nov 06 06:28:46 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:28:46 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:28:46 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:28:46 user nova-compute[74903]:   </cpu>
Nov 06 06:28:46 user nova-compute[74903]:   <devices>
Nov 06 06:28:46 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:28:46 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:28:46 user nova-compute[74903]:       <source dev="/dev/sdc"/>
Nov 06 06:28:46 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:28:46 user nova-compute[74903]:       <serial>a8822c4f-27ad-4fef-b9ef-c869438e2838</serial>
Nov 06 06:28:46 user nova-compute[74903]:     </disk>
Nov 06 06:28:46 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:28:46 user nova-compute[74903]:       <mac address="fa:16:3e:eb:c2:bc"/>
Nov 06 06:28:46 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:28:46 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:28:46 user nova-compute[74903]:       <target dev="tapd48a71a1-77"/>
Nov 06 06:28:46 user nova-compute[74903]:     </interface>
Nov 06 06:28:46 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:28:46 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/64cdf53e-7217-41a8-9fab-773432e1f9f1/console.log" append="off"/>
Nov 06 06:28:46 user nova-compute[74903]:     </serial>
Nov 06 06:28:46 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:28:46 user nova-compute[74903]:     <video>
Nov 06 06:28:46 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:28:46 user nova-compute[74903]:     </video>
Nov 06 06:28:46 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:28:46 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:28:46 user nova-compute[74903]:     </rng>
Nov 06 06:28:46 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:28:46 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:28:46 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:28:46 user nova-compute[74903]:     </memballoon>
Nov 06 06:28:46 user nova-compute[74903]:   </devices>
Nov 06 06:28:46 user nova-compute[74903]: </domain>
Nov 06 06:28:46 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1267869909',display_name='tempest-TestVolumeBootPattern-server-1267869909',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1267869909',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-40tl09eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:28:22Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=64cdf53e-7217-41a8-9fab-773432e1f9f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG os_vif [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '873fa6d6-478e-504b-852f-ddcfc35f42b1', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd48a71a1-77, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd48a71a1-77, col_values=(('qos', UUID('5ee42fa8-d6d3-4b55-9a11-6894afc8b940')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd48a71a1-77, col_values=(('external_ids', {'iface-id': 'd48a71a1-7745-4f3d-944b-8f483a4d831d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:c2:bc', 'vm-uuid': '64cdf53e-7217-41a8-9fab-773432e1f9f1'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:46 user nova-compute[74903]: INFO os_vif [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77')
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:eb:c2:bc, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:46 user nova-compute[74903]: INFO nova.compute.manager [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Detaching volume 3b8f35d5-109f-47e6-9fbd-75ce1390787b
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.compute.manager [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] No waiting events found dispatching network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:28:46 user nova-compute[74903]: WARNING nova.compute.manager [req-00ca3d99-fd9a-44fc-8411-ee5dbc880c57 req-deea8dae-7dfc-433f-b9eb-48050404ad66 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received unexpected event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd for instance with vm_state building and task_state spawning.
Nov 06 06:28:46 user nova-compute[74903]: INFO nova.virt.block_device [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Attempting to driver detach volume 3b8f35d5-109f-47e6-9fbd-75ce1390787b from mountpoint /dev/vdb
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Attempting to detach device vdb from instance d33ed773-a7e2-4b40-88ca-a27984d04d7e from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:28:46 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:28:46 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:28:46 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:28:46 user nova-compute[74903]:   <serial>3b8f35d5-109f-47e6-9fbd-75ce1390787b</serial>
Nov 06 06:28:46 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:28:46 user nova-compute[74903]: </disk>
Nov 06 06:28:46 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:28:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance d33ed773-a7e2-4b40-88ca-a27984d04d7e from the persistent domain config.
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d33ed773-a7e2-4b40-88ca-a27984d04d7e from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:28:46 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:28:46 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:28:46 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:28:46 user nova-compute[74903]:   <serial>3b8f35d5-109f-47e6-9fbd-75ce1390787b</serial>
Nov 06 06:28:46 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:28:46 user nova-compute[74903]: </disk>
Nov 06 06:28:46 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:28:46 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance spawned successfully.
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:47 user nova-compute[74903]: INFO nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 06 06:28:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:28:47 user nova-compute[74903]: INFO nova.compute.manager [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Took 7.19 seconds to build instance.
Nov 06 06:28:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0b25b540-b813-4140-80f2-87166836f96e tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.297s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] No waiting events found dispatching network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:28:48 user nova-compute[74903]: WARNING nova.compute.manager [req-939a3f79-d0be-4a2e-992d-cd4ec415d0c6 req-243da95f-10d1-4a72-9fee-e509c497ac0b service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received unexpected event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d for instance with vm_state building and task_state spawning.
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:28:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Instance spawned successfully.
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.compute.manager [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] No waiting events found dispatching network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:28:50 user nova-compute[74903]: WARNING nova.compute.manager [req-222b9044-2e78-40e5-971c-d9c6b4b159bd req-6023de21-deed-4d0c-905d-f1e909067795 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received unexpected event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d for instance with vm_state building and task_state spawning.
Nov 06 06:28:50 user nova-compute[74903]: INFO nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 06 06:28:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:28:50 user nova-compute[74903]: INFO nova.compute.manager [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Took 28.74 seconds to build instance.
Nov 06 06:28:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7198a39a-5573-465c-8350-d4c838f4198e tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.851s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:28:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:28:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:07 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d33ed773-a7e2-4b40-88ca-a27984d04d7e is timed out.
Nov 06 06:29:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully detached device vdb from instance d33ed773-a7e2-4b40-88ca-a27984d04d7e from the live domain config.
Nov 06 06:29:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvakjfEi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:29:07 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b9df9-7540-4a79-bd61-fe0ddf294972]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:29:07 user nova-compute[74903]: No targets found.
Nov 06 06:29:07 user nova-compute[74903]: iSNS:
Nov 06 06:29:07 user nova-compute[74903]: No targets found.
Nov 06 06:29:07 user nova-compute[74903]: STATIC:
Nov 06 06:29:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:29:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:29:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:29:07 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b
Nov 06 06:29:07 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:29:07 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:29:07 user nova-compute[74903]: FIRMWARE:
Nov 06 06:29:07 user nova-compute[74903]: No targets found.
Nov 06 06:29:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:29:07 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:29:07 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[36791483-8161-4975-9d20-795e5f40c841]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[588624e8-52d2-49f3-928c-a3b9522632b3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:29:07 user nova-compute[74903]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:29:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b (non-flash)
Nov 06 06:29:07 user nova-compute[74903]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:29:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa287b3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9abe0-394f-42fd-87d6-2c89e2425b14]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46c32d-cfc0-485a-837f-2fef00a0c2b5]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41c00d-3b6e-454d-877d-7912c6d0e33b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38943fc-c405-425b-b4c4-def424a74586]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b87709e-1527-493e-adf8-df5a8ddb825f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f76d28-17a9-4a1d-8a69-12aa5ec5b4d7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260]
Nov 06 06:29:07 user nova-compute[74903]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b, portal: 172.16.0.220,3260] successful.
Nov 06 06:29:07 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:29:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b8f35d5-109f-47e6-9fbd-75ce1390787b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c97bc0-1797-4c24-97d4-1e0359fda687]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] <== disconnect_volume: return (295ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:29:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:29:09 user nova-compute[74903]: DEBUG nova.objects.instance [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'flavor' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:29:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-aaea2ebe-9068-4e7c-baf9-672365c625b6 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.483s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [{"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-d33ed773-a7e2-4b40-88ca-a27984d04d7e" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:29:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:36 user nova-compute[74903]: INFO nova.compute.manager [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Terminating instance
Nov 06 06:29:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-unplugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] No waiting events found dispatching network-vif-unplugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.compute.manager [req-aea5e05b-0099-428d-813b-60188f39b7d9 req-33f9720c-ccfd-4152-8588-cc74ab7cead1 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-unplugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:29:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Instance destroyed successfully.
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lazy-loading 'resources' on Instance uuid d33ed773-a7e2-4b40-88ca-a27984d04d7e {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:26:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518849501',display_name='tempest-AttachVolumeNegativeTest-server-518849501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518849501',id=43,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEg185ZfatERE6xbC+Q0GhaQ2HRDLF7EUHUbxejbzUiGbO4prP9XIsgstkzxVDXAn3q9Sn3CLd2Tr0cDXgx/cY3OKaty+MezdaVtxEH7wiQfXWSdXQrxZ85VsmE2dW8KEg==',key_name='tempest-keypair-1021199660',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:26:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ac2801ad3f4b75bc98d85071d479c6',ramdisk_id='',reservation_id='r-vfbntvx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1944196622',owner_user_name='tempest-AttachVolumeNegativeTest-1944196622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8673337612a54ca0a89d180a830cbaf5',uuid=d33ed773-a7e2-4b40-88ca-a27984d04d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converting VIF {"id": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "address": "fa:16:3e:d3:8f:c1", "network": {"id": "a7b69972-c3b4-43df-89a7-70614987ad8c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-421214963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ac2801ad3f4b75bc98d85071d479c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4407b6-55", "ovs_interfaceid": "9e4407b6-55be-4f0a-a95e-0dfe580e8edd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG os_vif [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e4407b6-55, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0816bce-5246-458b-a289-c2a6690c3ad8) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:29:37 user nova-compute[74903]: INFO os_vif [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:8f:c1,bridge_name='br-int',has_traffic_filtering=True,id=9e4407b6-55be-4f0a-a95e-0dfe580e8edd,network=Network(a7b69972-c3b4-43df-89a7-70614987ad8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4407b6-55')
Nov 06 06:29:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Deleting instance files /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e_del
Nov 06 06:29:37 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Deletion of /opt/stack/data/nova/instances/d33ed773-a7e2-4b40-88ca-a27984d04d7e_del complete
Nov 06 06:29:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:37 user nova-compute[74903]: INFO nova.compute.manager [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 06:29:37 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:29:37 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:29:38 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Took 0.67 seconds to deallocate network for instance.
Nov 06 06:29:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG nova.compute.manager [req-2218ad3c-e376-4d7c-84d6-a4d859c91f9b req-2ecaef74-daf8-4ff3-836e-0294c47e647a service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-deleted-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:29:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:38 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Deleted allocations for instance d33ed773-a7e2-4b40-88ca-a27984d04d7e
Nov 06 06:29:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7b20ffce-744d-4aff-9d85-cffa05ae11b2 tempest-AttachVolumeNegativeTest-1944196622 tempest-AttachVolumeNegativeTest-1944196622-project-member] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.917s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:29:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] Acquiring lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:39 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] Lock "d33ed773-a7e2-4b40-88ca-a27984d04d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:39 user nova-compute[74903]: DEBUG nova.compute.manager [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] No waiting events found dispatching network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:29:39 user nova-compute[74903]: WARNING nova.compute.manager [req-6308e53c-6b48-4579-8f9e-cd8e667c7b18 req-805fe681-a23d-4dd5-92e1-5c6bdeaf5521 service nova] [instance: d33ed773-a7e2-4b40-88ca-a27984d04d7e] Received unexpected event network-vif-plugged-9e4407b6-55be-4f0a-a95e-0dfe580e8edd for instance with vm_state deleted and task_state None.
Nov 06 06:29:40 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:29:41 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:29:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:29:42 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=25.21570587158203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 64cdf53e-7217-41a8-9fab-773432e1f9f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 11a2c3e4-7008-40c1-846c-55aad9073cbb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:29:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:29:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:29:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-changed-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:30:13 user nova-compute[74903]: DEBUG nova.compute.manager [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Refreshing instance network info cache due to event network-changed-d48a71a1-7745-4f3d-944b-8f483a4d831d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:30:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] Acquiring lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:30:13 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] Acquired lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:30:13 user nova-compute[74903]: DEBUG nova.network.neutron [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Refreshing network info cache for port d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updated VIF entry in instance network info cache for port d48a71a1-7745-4f3d-944b-8f483a4d831d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.network.neutron [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating instance_info_cache with network_info: [{"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1f50bc9f-cf87-415a-ae8c-68e692df2243 req-01150630-30ad-4892-8a14-7a974a9df8b6 service nova] Releasing lock "refresh_cache-64cdf53e-7217-41a8-9fab-773432e1f9f1" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:14 user nova-compute[74903]: INFO nova.compute.manager [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Terminating instance
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-unplugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] No waiting events found dispatching network-vif-unplugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-229b12fb-ea51-470e-8665-2d08f64b4c64 req-a3d2e86a-7877-4b3b-9a99-97bfdc89e797 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-unplugged-d48a71a1-7745-4f3d-944b-8f483a4d831d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:30:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Instance destroyed successfully.
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid 64cdf53e-7217-41a8-9fab-773432e1f9f1 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1267869909',display_name='tempest-TestVolumeBootPattern-server-1267869909',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1267869909',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-40tl09eu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:28:51Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=64cdf53e-7217-41a8-9fab-773432e1f9f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "address": "fa:16:3e:eb:c2:bc", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd48a71a1-77", "ovs_interfaceid": "d48a71a1-7745-4f3d-944b-8f483a4d831d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_vif [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd48a71a1-77, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ee42fa8-d6d3-4b55-9a11-6894afc8b940) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:30:15 user nova-compute[74903]: INFO os_vif [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:c2:bc,bridge_name='br-int',has_traffic_filtering=True,id=d48a71a1-7745-4f3d-944b-8f483a4d831d,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd48a71a1-77')
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:30:15 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b18508-4750-48e1-8cf5-caa215803c43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:30:15 user nova-compute[74903]: No targets found.
Nov 06 06:30:15 user nova-compute[74903]: iSNS:
Nov 06 06:30:15 user nova-compute[74903]: No targets found.
Nov 06 06:30:15 user nova-compute[74903]: STATIC:
Nov 06 06:30:15 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:30:15 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:30:15 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:30:15 user nova-compute[74903]: FIRMWARE:
Nov 06 06:30:15 user nova-compute[74903]: No targets found.
Nov 06 06:30:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:30:15 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:30:15 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf5767a-3bf1-4f53-9a5a-f112a39dba62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b0c4d8-f633-4dd3-b9b4-d718eec64da3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:30:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:30:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28629d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[346794b3-c9f7-4775-8b33-918a8d3f0dcd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f047d3-1b43-4f1b-bcae-bf710915ac5f]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9673149-f2bf-425d-a6fb-8041d1515cbc]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba667c-757e-47da-8471-0ec0b8d116f7]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf471029d-bc304426830c1e89', '/dev/disk/by-id/scsi-26263333034343236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f471029d') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5706f3-0698-405a-b9ff-f4982bfb48f2]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce473b8-e7c4-4871-91a6-0e8b16170b05]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cbf6f2-2813-4f3b-a8b5-c6068eaa1560]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]
Nov 06 06:30:15 user nova-compute[74903]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.
Nov 06 06:30:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5565daf3-3c13-42ce-b059-5971340e9bdb]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (296ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:30:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Deleting instance files /opt/stack/data/nova/instances/64cdf53e-7217-41a8-9fab-773432e1f9f1_del
Nov 06 06:30:15 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Deletion of /opt/stack/data/nova/instances/64cdf53e-7217-41a8-9fab-773432e1f9f1_del complete
Nov 06 06:30:15 user nova-compute[74903]: INFO nova.compute.manager [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 06 06:30:15 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:30:15 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:30:16 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Took 0.91 seconds to deallocate network for instance.
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-3337a95b-a755-4043-8f72-386ef94783fb req-25accc67-da30-4d4c-9ddc-d47cc12d11c5 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-deleted-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:30:16 user nova-compute[74903]: INFO nova.compute.manager [req-3337a95b-a755-4043-8f72-386ef94783fb req-25accc67-da30-4d4c-9ddc-d47cc12d11c5 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Neutron deleted interface d48a71a1-7745-4f3d-944b-8f483a4d831d; detaching it from the instance and deleting it from the info cache
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.network.neutron [req-3337a95b-a755-4043-8f72-386ef94783fb req-25accc67-da30-4d4c-9ddc-d47cc12d11c5 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-3337a95b-a755-4043-8f72-386ef94783fb req-25accc67-da30-4d4c-9ddc-d47cc12d11c5 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Detach interface failed, port_id=d48a71a1-7745-4f3d-944b-8f483a4d831d, reason: Instance 64cdf53e-7217-41a8-9fab-773432e1f9f1 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] Acquiring lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:16 user nova-compute[74903]: DEBUG nova.compute.manager [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] No waiting events found dispatching network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:30:16 user nova-compute[74903]: WARNING nova.compute.manager [req-81a432cf-339a-4f57-a677-136d4f8a3fdb req-5c38c436-9091-42eb-8520-49a73a03d192 service nova] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Received unexpected event network-vif-plugged-d48a71a1-7745-4f3d-944b-8f483a4d831d for instance with vm_state active and task_state deleting.
Nov 06 06:30:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:17 user nova-compute[74903]: INFO nova.compute.manager [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: 64cdf53e-7217-41a8-9fab-773432e1f9f1] Took 0.87 seconds to detach 1 volumes for instance.
Nov 06 06:30:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:17 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:30:17 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:30:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:17 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance 64cdf53e-7217-41a8-9fab-773432e1f9f1
Nov 06 06:30:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d65671a0-3829-449a-a9ac-86797a20933f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "64cdf53e-7217-41a8-9fab-773432e1f9f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.555s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-changed-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG nova.compute.manager [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Refreshing instance network info cache due to event network-changed-d9f47457-fc41-4063-9b43-f72570c491dd. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] Acquiring lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] Acquired lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:30:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Refreshing network info cache for port d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updated VIF entry in instance network info cache for port d9f47457-fc41-4063-9b43-f72570c491dd. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-951f8be7-5517-4b87-bcf9-8422ee577d87 req-15c3cc48-3b17-4466-8d90-f854ae02ea86 service nova] Releasing lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:30:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:30:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG nova.objects.instance [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:30:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:37 user nova-compute[74903]: INFO nova.compute.manager [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attaching volume 8ee6e1af-68e9-492f-a1ff-65994f4aa9bd to /dev/vdb
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.utils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6fa7d8-7891-44c9-b0ca-68cb8dc4cf7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae28aaa4-67c6-4e42-8084-a50cbc6ef28e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2bd10c-054b-4589-94ac-d59c2245bd4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6218b0-49a2-4542-8df8-ab9ddf79250a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:30:37 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:30:37 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4260d23-9fb4-495c-845b-498ba9ac59bf]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG os_brick.utils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating existing volume attachment record: c603e0e4-89bb-483d-bb41-7db5031a95a0 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:30:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:30:44 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.206390380859375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 11a2c3e4-7008-40c1-846c-55aad9073cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:30:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:30:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:30:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcJdwKxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:30:57 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:30:57 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:30:57 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:30:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3dda6e-1ac4-466b-9af0-3d754390fa5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:30:57 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503ecf7-2e11-4645-b706-12ce42477fa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd] added
Nov 06 06:30:58 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20066e3b-2522-4788-8f4b-bde5ca62aca6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae13f3-f85c-4245-8b3b-370e883b3ed6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcJdwKxQ {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcJdwKxQ" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae77da-8a92-4ab4-aab7-80afb6587e74]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcJdwKxQ'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e4bd2-f3a6-48da-bee0-81c5684f5a16]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e38989f-2742-4c08-a5ef-9ec9cfc8a45e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:30:58 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:30:58 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:30:58 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:30:58 user nova-compute[74903]: 
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24cedce-117e-418c-a6ea-6f42ea3ca1ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260]
Nov 06 06:30:58 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260] successful.
Nov 06 06:30:58 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bde6a-ceb9-4d3f-9359-59d8d1bbf37a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc58981-5264-4771-903d-db1b2300b825]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:30:58 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:30:58 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ea1ce5-39fd-4dd1-b5d4-a383bb47bd83]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:30:58 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcJdwKxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23139363066356133', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139363066356133', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.objects.instance [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:30:59 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:30:59 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:30:59 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:30:59 user nova-compute[74903]:   <serial>8ee6e1af-68e9-492f-a1ff-65994f4aa9bd</serial>
Nov 06 06:30:59 user nova-compute[74903]: </disk>
Nov 06 06:30:59 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No VIF found with MAC fa:16:3e:13:a6:9d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:30:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-55ff7f30-a3d0-434c-a3a3-d9a799d8b1a7 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.829s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Verify base images {{(pid=74903) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Image id e8f85acc-7dce-4172-bf4e-a640a545c91b yields fingerprint b6dc1b71a33048dfaa1347e252af6f874a36a4da {{(pid=74903) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] image e8f85acc-7dce-4172-bf4e-a640a545c91b at (/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da): checking
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] image e8f85acc-7dce-4172-bf4e-a640a545c91b at (/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da): image is in use {{(pid=74903) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74903) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] 11a2c3e4-7008-40c1-846c-55aad9073cbb is a valid instance name {{(pid=74903) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] 11a2c3e4-7008-40c1-846c-55aad9073cbb has a disk file {{(pid=74903) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 11a2c3e4-7008-40c1-846c-55aad9073cbb is backed by b6dc1b71a33048dfaa1347e252af6f874a36a4da {{(pid=74903) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346
Nov 06 06:31:01 user nova-compute[74903]: WARNING nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Active base files: /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Removable base files: /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5 /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35 /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0 /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346 /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/174dd2b542eb370d7ceecb1e72d009ca4aeb8ca5
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/aa757cf2b27473bed1db9f732cb161d2e7ed2f5d
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2178407ac970efbfaef736777990d3b25583db35
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d016af5da35822464662bc288bc9df416ab204c0
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3d16879ac319429107867fcaaa9548557061346
Nov 06 06:31:01 user nova-compute[74903]: INFO nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/48c2b478b7beee67ff3ba9d559f5e01f0de9d1a7
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Verification complete {{(pid=74903) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Verify swap images {{(pid=74903) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 06 06:31:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.imagecache [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Verify ephemeral images {{(pid=74903) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 06 06:31:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:31:06 user nova-compute[74903]: INFO nova.compute.claims [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Claim successful on node user
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:06 user nova-compute[74903]: INFO nova.compute.manager [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attaching volume 3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 to /dev/vdc
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG os_brick.utils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5d838-3cb8-4592-8b92-24414d515b94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf719f-bc22-4cf4-ac24-2029eb552b95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9659cad-bd8d-4468-b710-67975bdfd6b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f30537-9570-42ea-9c0d-53d79e35c41d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:31:06 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:31:07 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eee7d2-5e43-4996-8d02-fc6c6aa63d87]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.utils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating existing volume attachment record: 3f3e690b-4836-413b-a91b-1d40e87e6720 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:31:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.policy [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:31:07 user nova-compute[74903]: INFO nova.virt.block_device [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Booting with volume a8822c4f-27ad-4fef-b9ef-c869438e2838 at /dev/vda
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.utils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7058e7f8-0922-4007-99ac-7783740cfbed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a0430d-43b5-4f04-9360-c20c083540fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e53691a-a6f3-47ef-b1f5-1e5380e4bcb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc44f6a-d300-4ea2-8e7e-61387617b154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:31:07 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:31:07 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9751c-0b75-410f-a1e9-6682e924f862]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG os_brick.utils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating existing volume attachment record: cc26ff5c-e184-4c5e-a732-5f8b69b4639d {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:31:07 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Successfully created port: 24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Successfully updated port: 24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing instance network info cache due to event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.network.neutron [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Instance network_info: |[{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:31:08 user nova-compute[74903]: DEBUG nova.network.neutron [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:31:09 user nova-compute[74903]: DEBUG nova.network.neutron [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated VIF entry in instance network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:31:09 user nova-compute[74903]: DEBUG nova.network.neutron [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:31:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4b075e72-a6fc-4295-89db-5560f381ed7f req-a7ef28cd-d0a6-4923-9f52-c8ef823328eb service nova] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:31:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:31:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:24 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJprgeyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:31:28 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:31:28 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:31:28 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa643c71-b17c-481a-808a-e6838aef5904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:31:28 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f2d758-1f75-461c-bc2b-3ae2fe639abf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799] added
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffef067-419d-4527-9a90-9fb99d7c0d46]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc63238-fbc1-4ca5-b3a0-066457ddfef6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJprgeyQ {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJprgeyQ" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cf5f89-401b-4a5f-bac9-96caded8ed8b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJprgeyQ'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c303b94-f9c7-4aee-9165-a6e1aa938de7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac98c1e-1705-484d-b97c-469177e3cbd3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30dc1b2-0f33-4b27-9991-87da9763f683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260]
Nov 06 06:31:28 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260] successful.
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3b315-42fb-423b-a5cb-a3a9dd50231c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a99cc-1eaf-48ec-a30c-36d06708fa3c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:28 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:28 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:28 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e5ec28-4cf1-4e4b-9fe5-e22a8154777d]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:28 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJprgeyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23839626530653162', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839626530653162', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:31:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Creating image(s)
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Ensure instance console log exists: /opt/stack/data/nova/instances/c316d330-f6d9-4a5c-970a-e5c8446f9aa3/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Start _get_guest_xml network_info=[{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c316d330-f6d9-4a5c-970a-e5c8446f9aa3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8822c4f-27ad-4fef-b9ef-c869438e2838', 'serial': 'a8822c4f-27ad-4fef-b9ef-c869438e2838'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': 'cc26ff5c-e184-4c5e-a732-5f8b69b4639d', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:31:29 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:29 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:31:29 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:31:29 user nova-compute[74903]:   <serial>3b7ad502-88c5-49cd-b10b-5a7cf1c4e799</serial>
Nov 06 06:31:29 user nova-compute[74903]: </disk>
Nov 06 06:31:29 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:31:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:31:29 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:31:29 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:31:29 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:31:29 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c2e4ca-b6c1-4c6d-9df9-d4b2c18eb1a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:31:29 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[478cdf08-42b3-4d17-bbd9-679707f0fe5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838] added
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea70934-e0e0-4998-aafc-3a23d88e1a1d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[462abf49-30d0-4e45-adb5-1ddcc4738b65]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLzqocDb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lLzqocDb" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203420e-35c3-44a8-ad49-38f94e55f62e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lLzqocDb'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd4729-868b-4eb5-ab3d-b4e3ba9c0d67]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac015a-47a9-48b9-a547-5f57435223ed]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f24d7c-d427-4fe9-a21f-69d83f61a673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]
Nov 06 06:31:29 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[098fab06-b26c-4cee-ac45-c117c77c7667]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabec8b-1530-4178-a21e-5dcce0417904]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:31:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:31:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[139b2eb1-a01e-497e-8309-48694c22f35c]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] No VIF found with MAC fa:16:3e:13:a6:9d, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c6ae8cbd-e22e-427d-bf0b-32dc642c5fa8 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.422s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26263333034343236', 'path': '/dev/sdd'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263333034343236', 'path': '/dev/sdd'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1274916640',display_name='tempest-TestVolumeBootPattern-server-1274916640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1274916640',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-x52kzrdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:31:07Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=c316d330-f6d9-4a5c-970a-e5c8446f9aa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:31:31 user nova-compute[74903]:   <uuid>c316d330-f6d9-4a5c-970a-e5c8446f9aa3</uuid>
Nov 06 06:31:31 user nova-compute[74903]:   <name>instance-0000002e</name>
Nov 06 06:31:31 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:31:31 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:31:31 user nova-compute[74903]:   <metadata>
Nov 06 06:31:31 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:31:31 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:31:31 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-server-1274916640</nova:name>
Nov 06 06:31:31 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:31:29</nova:creationTime>
Nov 06 06:31:31 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:31:31 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:31:31 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:31:31 user nova-compute[74903]:       <nova:owner>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:31:31 user nova-compute[74903]:       </nova:owner>
Nov 06 06:31:31 user nova-compute[74903]:       <nova:ports>
Nov 06 06:31:31 user nova-compute[74903]:         <nova:port uuid="24b109b5-3d36-4513-83d8-c9d5f09eb4e5">
Nov 06 06:31:31 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:31:31 user nova-compute[74903]:         </nova:port>
Nov 06 06:31:31 user nova-compute[74903]:       </nova:ports>
Nov 06 06:31:31 user nova-compute[74903]:     </nova:instance>
Nov 06 06:31:31 user nova-compute[74903]:   </metadata>
Nov 06 06:31:31 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:31:31 user nova-compute[74903]:     <system>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="serial">c316d330-f6d9-4a5c-970a-e5c8446f9aa3</entry>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="uuid">c316d330-f6d9-4a5c-970a-e5c8446f9aa3</entry>
Nov 06 06:31:31 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:31:31 user nova-compute[74903]:     </system>
Nov 06 06:31:31 user nova-compute[74903]:   </sysinfo>
Nov 06 06:31:31 user nova-compute[74903]:   <os>
Nov 06 06:31:31 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:31:31 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:31:31 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:31:31 user nova-compute[74903]:   </os>
Nov 06 06:31:31 user nova-compute[74903]:   <features>
Nov 06 06:31:31 user nova-compute[74903]:     <acpi/>
Nov 06 06:31:31 user nova-compute[74903]:     <apic/>
Nov 06 06:31:31 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:31:31 user nova-compute[74903]:   </features>
Nov 06 06:31:31 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:31:31 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:31:31 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:31:31 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:31:31 user nova-compute[74903]:   </clock>
Nov 06 06:31:31 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:31:31 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:31:31 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:31:31 user nova-compute[74903]:   </cpu>
Nov 06 06:31:31 user nova-compute[74903]:   <devices>
Nov 06 06:31:31 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:31:31 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:31 user nova-compute[74903]:       <source dev="/dev/sdd"/>
Nov 06 06:31:31 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:31:31 user nova-compute[74903]:       <serial>a8822c4f-27ad-4fef-b9ef-c869438e2838</serial>
Nov 06 06:31:31 user nova-compute[74903]:     </disk>
Nov 06 06:31:31 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:31:31 user nova-compute[74903]:       <mac address="fa:16:3e:e9:1c:70"/>
Nov 06 06:31:31 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:31:31 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:31:31 user nova-compute[74903]:       <target dev="tap24b109b5-3d"/>
Nov 06 06:31:31 user nova-compute[74903]:     </interface>
Nov 06 06:31:31 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:31:31 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c316d330-f6d9-4a5c-970a-e5c8446f9aa3/console.log" append="off"/>
Nov 06 06:31:31 user nova-compute[74903]:     </serial>
Nov 06 06:31:31 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:31:31 user nova-compute[74903]:     <video>
Nov 06 06:31:31 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:31:31 user nova-compute[74903]:     </video>
Nov 06 06:31:31 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:31:31 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:31:31 user nova-compute[74903]:     </rng>
Nov 06 06:31:31 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:31:31 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:31:31 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:31:31 user nova-compute[74903]:     </memballoon>
Nov 06 06:31:31 user nova-compute[74903]:   </devices>
Nov 06 06:31:31 user nova-compute[74903]: </domain>
Nov 06 06:31:31 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1274916640',display_name='tempest-TestVolumeBootPattern-server-1274916640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1274916640',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-x52kzrdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:31:07Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=c316d330-f6d9-4a5c-970a-e5c8446f9aa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG os_vif [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd65cd4a7-2e38-5760-bdc7-45a9649b5ed7', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24b109b5-3d, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24b109b5-3d, col_values=(('qos', UUID('b35d971a-64e4-46ab-abe2-8fd68f451d9e')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24b109b5-3d, col_values=(('external_ids', {'iface-id': '24b109b5-3d36-4513-83d8-c9d5f09eb4e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:1c:70', 'vm-uuid': 'c316d330-f6d9-4a5c-970a-e5c8446f9aa3'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:31 user nova-compute[74903]: INFO os_vif [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d')
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:e9:1c:70, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Skipping network cache update for instance because it is Building. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 06:31:31 user nova-compute[74903]: INFO nova.compute.manager [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Detaching volume 8ee6e1af-68e9-492f-a1ff-65994f4aa9bd
Nov 06 06:31:31 user nova-compute[74903]: INFO nova.virt.block_device [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attempting to driver detach volume 8ee6e1af-68e9-492f-a1ff-65994f4aa9bd from mountpoint /dev/vdb
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Attempting to detach device vdb from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:31:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:31 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:31:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:31:31 user nova-compute[74903]:   <serial>8ee6e1af-68e9-492f-a1ff-65994f4aa9bd</serial>
Nov 06 06:31:31 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:31:31 user nova-compute[74903]: </disk>
Nov 06 06:31:31 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:31:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdb from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the persistent domain config.
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:31:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:31 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:31:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:31:31 user nova-compute[74903]:   <serial>8ee6e1af-68e9-492f-a1ff-65994f4aa9bd</serial>
Nov 06 06:31:31 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:31:31 user nova-compute[74903]: </disk>
Nov 06 06:31:31 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [{"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-11a2c3e4-7008-40c1-846c-55aad9073cbb" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:31:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:31:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] No waiting events found dispatching network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:31:33 user nova-compute[74903]: WARNING nova.compute.manager [req-26ead6a1-955b-4c77-b12b-12cdecf9e852 req-a85338dd-4ec6-4a3c-a0cf-67d1c6205b5d service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received unexpected event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 for instance with vm_state building and task_state spawning.
Nov 06 06:31:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:31:34 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Instance spawned successfully.
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:34 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:31:35 user nova-compute[74903]: INFO nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 06 06:31:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG nova.compute.manager [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] No waiting events found dispatching network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:31:35 user nova-compute[74903]: WARNING nova.compute.manager [req-04f19d8e-83a7-4519-bc30-3c2edecb79e0 req-76835996-c870-40fa-b454-67bda0ee9f9b service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received unexpected event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 for instance with vm_state building and task_state spawning.
Nov 06 06:31:35 user nova-compute[74903]: INFO nova.compute.manager [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Took 28.54 seconds to build instance.
Nov 06 06:31:35 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-c96bcc8f-2573-40c0-a3f1-c8d8afd9e91f tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.657s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:31:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:31:44 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:31:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:31:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.202865600585938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 11a2c3e4-7008-40c1-846c-55aad9073cbb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:31:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:31:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:51 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb is timed out.
Nov 06 06:31:51 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdb from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the live domain config.
Nov 06 06:31:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcJdwKxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:31:51 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[79febfd8-c2d9-4315-a143-ec6b59f116c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:31:51 user nova-compute[74903]: No targets found.
Nov 06 06:31:51 user nova-compute[74903]: iSNS:
Nov 06 06:31:51 user nova-compute[74903]: No targets found.
Nov 06 06:31:51 user nova-compute[74903]: STATIC:
Nov 06 06:31:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd
Nov 06 06:31:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:31:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:31:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799
Nov 06 06:31:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:31:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:31:51 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:31:51 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:31:51 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:31:51 user nova-compute[74903]: FIRMWARE:
Nov 06 06:31:51 user nova-compute[74903]: No targets found.
Nov 06 06:31:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:31:51 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:31:51 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9720db-b3c7-4679-8baa-56714e56ab78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87c541-ab39-4e7e-9eec-e60b3d4d2de8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:51 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:51 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:31:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd (non-flash)
Nov 06 06:31:51 user nova-compute[74903]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:31:51 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:31:51 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa28628b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ee3ab1-5018-4161-b275-04b04e7c3634]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[94937dfb-adfe-4e0e-ac35-53e1fc31537d]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d96068-a09b-48cb-93a6-91727bad9c2c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:31:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14e0bea-3f13-40e8-8ed7-250570810366]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6776b43a-750e-422b-94d9-e0c415386a9e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957c202-70fa-40ca-801b-15f2f371e387]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260]
Nov 06 06:31:52 user nova-compute[74903]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd, portal: 172.16.0.220,3260] successful.
Nov 06 06:31:52 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee6e1af-68e9-492f-a1ff-65994f4aa9bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368e251-c1ab-4ed1-9df7-fffcbce15bd4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== disconnect_volume: return (311ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:31:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:53 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:31:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8811a90a-17d5-4dbc-a841-53c9b85bc4e2 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.832s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:31:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:31:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:31:54 user nova-compute[74903]: INFO nova.compute.manager [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Detaching volume 3b7ad502-88c5-49cd-b10b-5a7cf1c4e799
Nov 06 06:31:54 user nova-compute[74903]: INFO nova.virt.block_device [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Attempting to driver detach volume 3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 from mountpoint /dev/vdc
Nov 06 06:31:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Attempting to detach device vdc from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:31:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:31:54 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:54 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:31:54 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:31:54 user nova-compute[74903]:   <serial>3b7ad502-88c5-49cd-b10b-5a7cf1c4e799</serial>
Nov 06 06:31:54 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:31:54 user nova-compute[74903]: </disk>
Nov 06 06:31:54 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:31:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdc from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the persistent domain config.
Nov 06 06:31:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:31:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:31:54 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:31:54 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:31:54 user nova-compute[74903]:   <target dev="vdc" bus="virtio"/>
Nov 06 06:31:54 user nova-compute[74903]:   <serial>3b7ad502-88c5-49cd-b10b-5a7cf1c4e799</serial>
Nov 06 06:31:54 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 06:31:54 user nova-compute[74903]: </disk>
Nov 06 06:31:54 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:31:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:31:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:31:57 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:31:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:31:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:32:05 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:32:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:14 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb is timed out.
Nov 06 06:32:14 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully detached device vdc from instance 11a2c3e4-7008-40c1-846c-55aad9073cbb from the live domain config.
Nov 06 06:32:14 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJprgeyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:32:14 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf00b30-3a32-489d-9c1e-bbbeac33d9df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:32:14 user nova-compute[74903]: No targets found.
Nov 06 06:32:14 user nova-compute[74903]: iSNS:
Nov 06 06:32:14 user nova-compute[74903]: No targets found.
Nov 06 06:32:14 user nova-compute[74903]: STATIC:
Nov 06 06:32:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799
Nov 06 06:32:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:32:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:32:14 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:32:14 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:32:14 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:32:14 user nova-compute[74903]: FIRMWARE:
Nov 06 06:32:14 user nova-compute[74903]: No targets found.
Nov 06 06:32:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:32:14 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:32:14 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce165ef-9d99-40c9-a854-60f8d2f60936]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[270e1c4a-22b2-474d-97dc-8db3f165b574]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:32:14 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:32:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 (non-flash)
Nov 06 06:32:14 user nova-compute[74903]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:32:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa086bf7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2628b9ad-cc1c-4a2b-9238-990248e0eb5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23072a-26fc-4ebb-87b8-01b22cdc1a45]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec5b01d-b78c-4515-aeae-00645bbbc089]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1415965-9709-4969-825f-710e2a045485]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad86561f-ade9-487c-af4e-e938bb9acf8d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:32:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d625f674-a171-4f27-b242-157092a5031b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260]
Nov 06 06:32:15 user nova-compute[74903]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799, portal: 172.16.0.220,3260] successful.
Nov 06 06:32:15 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7ad502-88c5-49cd-b10b-5a7cf1c4e799 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d457e4a-f57d-4cbe-9500-ec24605370e1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] <== disconnect_volume: return (314ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:32:15 user nova-compute[74903]: DEBUG nova.objects.instance [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'flavor' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:32:16 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-22b02a16-f7fe-459c-a95b-8e437a2e3601 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:17 user nova-compute[74903]: INFO nova.compute.manager [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Terminating instance
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-unplugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] No waiting events found dispatching network-vif-unplugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-9360dfaa-25a4-46ea-a57a-93e506ea1f61 req-236e2d12-7dfd-4329-b8e5-d4f87c20128a service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-unplugged-d9f47457-fc41-4063-9b43-f72570c491dd for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:32:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Instance destroyed successfully.
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.objects.instance [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lazy-loading 'resources' on Instance uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1121773370',display_name='tempest-AttachVolumeTestJSON-server-1121773370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1121773370',id=45,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGEElHag93cZqlM6jlLXu7Gxf594B81BvaG7uisco20/szuPE4S7ZzMy1BlCLOFBroCzqZHdzEQ6nGsvCOLaDvVEBQj1f0I5sBkoDUr/weISCzXkZJyJ9G3pM1aDqxbkw==',key_name='tempest-keypair-1738985970',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f0ee9f9d310436fb18fb51fe1c2b3b0',ramdisk_id='',reservation_id='r-mtcckj0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2127223018',owner_user_name='tempest-AttachVolumeTestJSON-2127223018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5ebd68316d430a86749b05b13ebf21',uuid=11a2c3e4-7008-40c1-846c-55aad9073cbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converting VIF {"id": "d9f47457-fc41-4063-9b43-f72570c491dd", "address": "fa:16:3e:13:a6:9d", "network": {"id": "ea3ac915-b7f6-4545-a02a-c1661434c916", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1495648666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f0ee9f9d310436fb18fb51fe1c2b3b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9f47457-fc", "ovs_interfaceid": "d9f47457-fc41-4063-9b43-f72570c491dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG os_vif [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9f47457-fc, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e461e776-712e-44cb-96b0-f05b240e7c2f) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:17 user nova-compute[74903]: INFO os_vif [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a6:9d,bridge_name='br-int',has_traffic_filtering=True,id=d9f47457-fc41-4063-9b43-f72570c491dd,network=Network(ea3ac915-b7f6-4545-a02a-c1661434c916),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9f47457-fc')
Nov 06 06:32:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Deleting instance files /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb_del
Nov 06 06:32:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Deletion of /opt/stack/data/nova/instances/11a2c3e4-7008-40c1-846c-55aad9073cbb_del complete
Nov 06 06:32:17 user nova-compute[74903]: INFO nova.compute.manager [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:32:17 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:32:17 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:32:18 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Took 0.82 seconds to deallocate network for instance.
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:18 user nova-compute[74903]: WARNING nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 11a2c3e4-7008-40c1-846c-55aad9073cbb {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-58236ba6-fa3c-4e12-aea9-e73f4738f572 req-c2131cdb-ce62-4b4f-b705-3fc654002249 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-deleted-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:32:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:18 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Deleted allocations for instance 11a2c3e4-7008-40c1-846c-55aad9073cbb
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-8db875f1-ffb5-4d78-9609-7004fe3f2331 tempest-AttachVolumeTestJSON-2127223018 tempest-AttachVolumeTestJSON-2127223018-project-member] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.289s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:19 user nova-compute[74903]: INFO nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] Acquiring lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] Lock "11a2c3e4-7008-40c1-846c-55aad9073cbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] No waiting events found dispatching network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:32:19 user nova-compute[74903]: WARNING nova.compute.manager [req-429e7d2f-9391-4687-832d-6841ee85a0f1 req-a4de0e26-1317-4384-a190-1946d0b48477 service nova] [instance: 11a2c3e4-7008-40c1-846c-55aad9073cbb] Received unexpected event network-vif-plugged-d9f47457-fc41-4063-9b43-f72570c491dd for instance with vm_state deleted and task_state None.
Nov 06 06:32:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:32:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:32:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:32:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:32:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:32:45 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=25.227436065673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:32:45 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:32:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:32:48 user nova-compute[74903]: INFO nova.compute.claims [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Claim successful on node user
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:32:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.policy [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4438973277784443b1dcc671adaac185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f674ff95744117a8e1e77c7d5953ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:32:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Creating image(s)
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Successfully created port: b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.virt.images [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] 22e18dc8-2623-456a-ae8a-8ee5031035e7 was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.part /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.part /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.converted" returned: 0 in 0.352s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Successfully updated port: b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.253s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.compute.manager [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing instance network info cache due to event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:32:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.neutron [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8118f614-ad8f-499f-b4c2-2aa31a6bdf3f req-bfc53113-fe5f-4cb0-ad39-cf87b93fba7b service nova] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757,backing_fmt=raw /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757,backing_fmt=raw /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk 1073741824" returned: 0 in 0.051s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "c235120a6a1bc564c89a843b6f2b0ffd8a79d757" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance network_info: |[{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Cannot resize image /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Ensure instance console log exists: /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start _get_guest_xml network_info=[{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T06:32:45Z,direct_url=<?>,disk_format='qcow2',id=22e18dc8-2623-456a-ae8a-8ee5031035e7,min_disk=0,min_ram=0,name='tempest-scenario-img--448408006',owner='46f674ff95744117a8e1e77c7d5953ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T06:32:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '22e18dc8-2623-456a-ae8a-8ee5031035e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:32:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:32:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T06:32:45Z,direct_url=<?>,disk_format='qcow2',id=22e18dc8-2623-456a-ae8a-8ee5031035e7,min_disk=0,min_ram=0,name='tempest-scenario-img--448408006',owner='46f674ff95744117a8e1e77c7d5953ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T06:32:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:32:49Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.objects.instance [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'pci_devices' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:32:50 user nova-compute[74903]:   <uuid>55a06a00-0c79-4e71-92fb-27b88221e4c7</uuid>
Nov 06 06:32:50 user nova-compute[74903]:   <name>instance-0000002f</name>
Nov 06 06:32:50 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:32:50 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:32:50 user nova-compute[74903]:   <metadata>
Nov 06 06:32:50 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:32:50 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:name>tempest-TestMinimumBasicScenario-server-334658449</nova:name>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:32:50</nova:creationTime>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:32:50 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:32:50 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:owner>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:user uuid="4438973277784443b1dcc671adaac185">tempest-TestMinimumBasicScenario-1990117235-project-member</nova:user>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:project uuid="46f674ff95744117a8e1e77c7d5953ba">tempest-TestMinimumBasicScenario-1990117235</nova:project>
Nov 06 06:32:50 user nova-compute[74903]:       </nova:owner>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:root type="image" uuid="22e18dc8-2623-456a-ae8a-8ee5031035e7"/>
Nov 06 06:32:50 user nova-compute[74903]:       <nova:ports>
Nov 06 06:32:50 user nova-compute[74903]:         <nova:port uuid="b4bb459b-b7db-453e-bdea-ee3047acde4d">
Nov 06 06:32:50 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:32:50 user nova-compute[74903]:         </nova:port>
Nov 06 06:32:50 user nova-compute[74903]:       </nova:ports>
Nov 06 06:32:50 user nova-compute[74903]:     </nova:instance>
Nov 06 06:32:50 user nova-compute[74903]:   </metadata>
Nov 06 06:32:50 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:32:50 user nova-compute[74903]:     <system>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="serial">55a06a00-0c79-4e71-92fb-27b88221e4c7</entry>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="uuid">55a06a00-0c79-4e71-92fb-27b88221e4c7</entry>
Nov 06 06:32:50 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:32:50 user nova-compute[74903]:     </system>
Nov 06 06:32:50 user nova-compute[74903]:   </sysinfo>
Nov 06 06:32:50 user nova-compute[74903]:   <os>
Nov 06 06:32:50 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:32:50 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:32:50 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:32:50 user nova-compute[74903]:   </os>
Nov 06 06:32:50 user nova-compute[74903]:   <features>
Nov 06 06:32:50 user nova-compute[74903]:     <acpi/>
Nov 06 06:32:50 user nova-compute[74903]:     <apic/>
Nov 06 06:32:50 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:32:50 user nova-compute[74903]:   </features>
Nov 06 06:32:50 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:32:50 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:32:50 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:32:50 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:32:50 user nova-compute[74903]:   </clock>
Nov 06 06:32:50 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:32:50 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:32:50 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:32:50 user nova-compute[74903]:   </cpu>
Nov 06 06:32:50 user nova-compute[74903]:   <devices>
Nov 06 06:32:50 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:32:50 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:32:50 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk"/>
Nov 06 06:32:50 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:32:50 user nova-compute[74903]:     </disk>
Nov 06 06:32:50 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:32:50 user nova-compute[74903]:       <mac address="fa:16:3e:58:be:6f"/>
Nov 06 06:32:50 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:32:50 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:32:50 user nova-compute[74903]:       <target dev="tapb4bb459b-b7"/>
Nov 06 06:32:50 user nova-compute[74903]:     </interface>
Nov 06 06:32:50 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:32:50 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/console.log" append="off"/>
Nov 06 06:32:50 user nova-compute[74903]:     </serial>
Nov 06 06:32:50 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:32:50 user nova-compute[74903]:     <video>
Nov 06 06:32:50 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:32:50 user nova-compute[74903]:     </video>
Nov 06 06:32:50 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:32:50 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:32:50 user nova-compute[74903]:     </rng>
Nov 06 06:32:50 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:32:50 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:32:50 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:32:50 user nova-compute[74903]:     </memballoon>
Nov 06 06:32:50 user nova-compute[74903]:   </devices>
Nov 06 06:32:50 user nova-compute[74903]: </domain>
Nov 06 06:32:50 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:32:49Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG os_vif [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30129baf-f275-5f3e-93f1-837288975b79', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4bb459b-b7, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4bb459b-b7, col_values=(('qos', UUID('60d96321-064b-46b6-81ac-1abfeb11ddf9')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4bb459b-b7, col_values=(('external_ids', {'iface-id': 'b4bb459b-b7db-453e-bdea-ee3047acde4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:be:6f', 'vm-uuid': '55a06a00-0c79-4e71-92fb-27b88221e4c7'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:50 user nova-compute[74903]: INFO os_vif [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7')
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:32:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No VIF found with MAC fa:16:3e:58:be:6f, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG nova.compute.manager [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:32:52 user nova-compute[74903]: WARNING nova.compute.manager [req-62c2034b-16fa-4aa4-bac7-b062d28f5d99 req-dd66dd17-342f-455a-982e-a0953fd068b3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state building and task_state spawning.
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:32:54 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance spawned successfully.
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:32:54 user nova-compute[74903]: INFO nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Took 5.68 seconds to spawn the instance on the hypervisor.
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:54 user nova-compute[74903]: DEBUG nova.compute.manager [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:32:54 user nova-compute[74903]: WARNING nova.compute.manager [req-1a905c96-c932-4b30-a742-b469a30bf4a8 req-1d5c53d5-2e35-4879-be43-439ed9e9f4a8 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state building and task_state spawning.
Nov 06 06:32:54 user nova-compute[74903]: INFO nova.compute.manager [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Took 6.41 seconds to build instance.
Nov 06 06:32:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-d33361f5-5319-41ce-97cb-15ebcfe136fe tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.509s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:32:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG nova.compute.manager [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing instance network info cache due to event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG nova.network.neutron [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG nova.network.neutron [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated VIF entry in instance network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG nova.network.neutron [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:32:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-10cc8e64-8e5f-44ed-a6e5-8555c91ae9d9 req-96c5f10a-b9a7-4864-8b8c-6b2f030d9a8e service nova] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:33:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:33:25 user nova-compute[74903]: INFO nova.compute.claims [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Claim successful on node user
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:33:25 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:33:25 user nova-compute[74903]: INFO nova.virt.block_device [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Booting with volume d56f3df0-5011-41a2-a436-a71bbf605598 at /dev/vda
Nov 06 06:33:25 user nova-compute[74903]: DEBUG nova.policy [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e598c1904d5b476098cfa01d389dd816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ca8acfbfb24a858078fcd5fd25f2fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:33:25 user nova-compute[74903]: DEBUG os_brick.utils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60d48e-cecf-4a07-a9ac-f6323af07503]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac8033-6ced-471e-9da7-3789ba2bb8c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fdea2b-25b8-4705-af4a-f70aea6f2b4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda56b3-3e45-477a-a197-5d297c5683c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:33:26 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:33:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[201c86da-726e-47e6-be83-9b1f6b07e4b3]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG os_brick.utils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating existing volume attachment record: 29f64115-40be-4c69-9891-32c998c3413d {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:33:26 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Successfully created port: 16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Successfully updated port: 16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquired lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.compute.manager [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing instance network info cache due to event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] Acquiring lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating instance_info_cache with network_info: [{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Releasing lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Instance network_info: |[{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] Acquired lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updated VIF entry in instance network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG nova.network.neutron [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating instance_info_cache with network_info: [{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:33:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1c4d0566-16f6-4ccf-ab56-d4a7f4f3adfe req-37c198d1-5425-44c3-8055-ffba59f838c3 service nova] Releasing lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:33:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Skipping network cache update for instance because it is Building. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:33:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:33:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:39 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:33:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:33:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:33:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:33:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:33:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:33:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.12813949584961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bb9804de-365f-4781-b464-21f3767a59d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:33:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:33:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:33:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:33:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:34:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Creating image(s)
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Did not create local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Ensure instance console log exists: /opt/stack/data/nova/instances/bb9804de-365f-4781-b464-21f3767a59d7/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Start _get_guest_xml network_info=[{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfdLJPbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb9804de-365f-4781-b464-21f3767a59d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'd56f3df0-5011-41a2-a436-a71bbf605598', 'serial': 'd56f3df0-5011-41a2-a436-a71bbf605598'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'attachment_id': '29f64115-40be-4c69-9891-32c998c3413d', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:34:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:34:03 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfdLJPbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:34:03 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:34:03 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:34:03 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f1c2b6-a4e1-44db-9532-debe532acc0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:34:03 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a95f6-2691-4ec8-bc2f-ceaad30daea0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598] added
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[706034e8-fd73-4420-b711-cd5ec4dd7972]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40cdbc-2814-43bd-98af-64dc41c85d69]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfdLJPbh {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfdLJPbh" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697d22f-c65b-441c-a2cb-f65dd3c8f12a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfdLJPbh'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f4201c-b8a7-45fc-adb5-756520b82711]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba57a19-3b01-4f3a-a650-fde84efea553]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[077f82aa-badb-4e84-b346-ef6a88cf4e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260]
Nov 06 06:34:03 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260] successful.
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeaa94e-4b16-4169-ac5e-bd7e5d58798a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b82f28-6542-4031-915d-f0692b878932]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)
Nov 06 06:34:03 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e10e41-dee9-42b5-99b6-049c0bc4ec4f]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:34:03 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfdLJPbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23563366239643239', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563366239643239', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881984020',display_name='tempest-TestVolumeBootPattern-server-1881984020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881984020',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-y0z60u5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:33:26Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=bb9804de-365f-4781-b464-21f3767a59d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.objects.instance [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'pci_devices' on Instance uuid bb9804de-365f-4781-b464-21f3767a59d7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:34:04 user nova-compute[74903]:   <uuid>bb9804de-365f-4781-b464-21f3767a59d7</uuid>
Nov 06 06:34:04 user nova-compute[74903]:   <name>instance-00000030</name>
Nov 06 06:34:04 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:34:04 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:34:04 user nova-compute[74903]:   <metadata>
Nov 06 06:34:04 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:34:04 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:34:04 user nova-compute[74903]:       <nova:name>tempest-TestVolumeBootPattern-server-1881984020</nova:name>
Nov 06 06:34:04 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:34:03</nova:creationTime>
Nov 06 06:34:04 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:34:04 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:34:04 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:34:04 user nova-compute[74903]:       <nova:owner>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:user uuid="e598c1904d5b476098cfa01d389dd816">tempest-TestVolumeBootPattern-251399615-project-member</nova:user>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:project uuid="f4ca8acfbfb24a858078fcd5fd25f2fe">tempest-TestVolumeBootPattern-251399615</nova:project>
Nov 06 06:34:04 user nova-compute[74903]:       </nova:owner>
Nov 06 06:34:04 user nova-compute[74903]:       <nova:ports>
Nov 06 06:34:04 user nova-compute[74903]:         <nova:port uuid="16e11ed7-9a0c-4260-b326-1257e09a7bbb">
Nov 06 06:34:04 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:34:04 user nova-compute[74903]:         </nova:port>
Nov 06 06:34:04 user nova-compute[74903]:       </nova:ports>
Nov 06 06:34:04 user nova-compute[74903]:     </nova:instance>
Nov 06 06:34:04 user nova-compute[74903]:   </metadata>
Nov 06 06:34:04 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:34:04 user nova-compute[74903]:     <system>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="serial">bb9804de-365f-4781-b464-21f3767a59d7</entry>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="uuid">bb9804de-365f-4781-b464-21f3767a59d7</entry>
Nov 06 06:34:04 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:34:04 user nova-compute[74903]:     </system>
Nov 06 06:34:04 user nova-compute[74903]:   </sysinfo>
Nov 06 06:34:04 user nova-compute[74903]:   <os>
Nov 06 06:34:04 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:34:04 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:34:04 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:34:04 user nova-compute[74903]:   </os>
Nov 06 06:34:04 user nova-compute[74903]:   <features>
Nov 06 06:34:04 user nova-compute[74903]:     <acpi/>
Nov 06 06:34:04 user nova-compute[74903]:     <apic/>
Nov 06 06:34:04 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:34:04 user nova-compute[74903]:   </features>
Nov 06 06:34:04 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:34:04 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:34:04 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:34:04 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:34:04 user nova-compute[74903]:   </clock>
Nov 06 06:34:04 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:34:04 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:34:04 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:34:04 user nova-compute[74903]:   </cpu>
Nov 06 06:34:04 user nova-compute[74903]:   <devices>
Nov 06 06:34:04 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:34:04 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:34:04 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:34:04 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:34:04 user nova-compute[74903]:       <serial>d56f3df0-5011-41a2-a436-a71bbf605598</serial>
Nov 06 06:34:04 user nova-compute[74903]:     </disk>
Nov 06 06:34:04 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:34:04 user nova-compute[74903]:       <mac address="fa:16:3e:79:fc:90"/>
Nov 06 06:34:04 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:34:04 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:34:04 user nova-compute[74903]:       <target dev="tap16e11ed7-9a"/>
Nov 06 06:34:04 user nova-compute[74903]:     </interface>
Nov 06 06:34:04 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:34:04 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/bb9804de-365f-4781-b464-21f3767a59d7/console.log" append="off"/>
Nov 06 06:34:04 user nova-compute[74903]:     </serial>
Nov 06 06:34:04 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:34:04 user nova-compute[74903]:     <video>
Nov 06 06:34:04 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:34:04 user nova-compute[74903]:     </video>
Nov 06 06:34:04 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:34:04 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:34:04 user nova-compute[74903]:     </rng>
Nov 06 06:34:04 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:34:04 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:34:04 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:34:04 user nova-compute[74903]:     </memballoon>
Nov 06 06:34:04 user nova-compute[74903]:   </devices>
Nov 06 06:34:04 user nova-compute[74903]: </domain>
Nov 06 06:34:04 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881984020',display_name='tempest-TestVolumeBootPattern-server-1881984020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881984020',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-y0z60u5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:33:26Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=bb9804de-365f-4781-b464-21f3767a59d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG os_vif [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e5cac6f-fe0a-5a9f-bf4f-640febcfdecb', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16e11ed7-9a, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16e11ed7-9a, col_values=(('qos', UUID('e564371c-bdce-45a5-896c-a7b9212aa70f')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16e11ed7-9a, col_values=(('external_ids', {'iface-id': '16e11ed7-9a0c-4260-b326-1257e09a7bbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:fc:90', 'vm-uuid': 'bb9804de-365f-4781-b464-21f3767a59d7'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:04 user nova-compute[74903]: INFO os_vif [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a')
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:34:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] No VIF found with MAC fa:16:3e:79:fc:90, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:34:06 user nova-compute[74903]: WARNING nova.compute.manager [req-3b2ae421-2001-4861-b8b5-0250d44a0716 req-34cd9e48-61aa-4dd2-8474-43a50cc3ff74 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state building and task_state spawning.
Nov 06 06:34:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:34:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Instance spawned successfully.
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:34:08 user nova-compute[74903]: INFO nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:08 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:34:08 user nova-compute[74903]: WARNING nova.compute.manager [req-4f5ac2ca-cfa3-4a2d-a602-5beecb2d9146 req-2b75ead8-34c7-4f33-9117-c03a4837c422 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state building and task_state spawning.
Nov 06 06:34:08 user nova-compute[74903]: INFO nova.compute.manager [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Took 43.02 seconds to build instance.
Nov 06 06:34:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-ca504a23-d233-4378-9eeb-1caea536f606 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.116s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:34:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:34:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:40 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG nova.objects.instance [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:44 user nova-compute[74903]: INFO nova.compute.manager [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Attaching volume a96c8320-d5e3-4627-b1bb-a2e45427647f to /dev/vdb
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.utils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab8f476-2c82-405f-844c-bb17ccdf72ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1b5de-6f0f-4bd6-96f0-964c33111da7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd494291-ba87-4509-8dd9-da8495bc35df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b0c79-91f4-4aec-bc2b-65fad5d9a08c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:34:44 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:34:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e60562-cb31-4983-b269-0e2f09762228]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG os_brick.utils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:34:44 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating existing volume attachment record: 009106c4-a0e8-4718-bbc3-6cc5e766ef58 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:34:46 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:34:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:34:47 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.125343322753906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance bb9804de-365f-4781-b464-21f3767a59d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:34:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:34:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:34:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:34:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing instance network info cache due to event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:35:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] Acquiring lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:35:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] Acquired lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:35:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updated VIF entry in instance network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating instance_info_cache with network_info: [{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fd4ca519-dc21-44d7-81da-324de5e1aec1 req-4e898a13-f9f1-4559-85c9-eb8bb8a68c57 service nova] Releasing lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:18 user nova-compute[74903]: INFO nova.compute.manager [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Terminating instance
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.compute.manager [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-377f7ff3-a38d-437c-90d5-d3e4c375dd9f req-7eb6f204-2e32-4fb3-b61e-69c836c489a0 service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Instance destroyed successfully.
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.objects.instance [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid bb9804de-365f-4781-b464-21f3767a59d7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1881984020',display_name='tempest-TestVolumeBootPattern-server-1881984020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1881984020',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-y0z60u5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:34:08Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=bb9804de-365f-4781-b464-21f3767a59d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_vif [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16e11ed7-9a, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e564371c-bdce-45a5-896c-a7b9212aa70f) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: INFO os_vif [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:fc:90,bridge_name='br-int',has_traffic_filtering=True,id=16e11ed7-9a0c-4260-b326-1257e09a7bbb,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e11ed7-9a')
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfdLJPbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:35:19 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e998b906-4912-46e8-af30-e241dfaacf91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:35:19 user nova-compute[74903]: No targets found.
Nov 06 06:35:19 user nova-compute[74903]: iSNS:
Nov 06 06:35:19 user nova-compute[74903]: No targets found.
Nov 06 06:35:19 user nova-compute[74903]: STATIC:
Nov 06 06:35:19 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598
Nov 06 06:35:19 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:35:19 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:35:19 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:35:19 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:35:19 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:35:19 user nova-compute[74903]: FIRMWARE:
Nov 06 06:35:19 user nova-compute[74903]: No targets found.
Nov 06 06:35:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:35:19 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:35:19 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[54166296-9908-44eb-88b4-f26c2bfd34c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b3ffe-da10-4494-aa87-88ecf24e6ce6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:19 user nova-compute[74903]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)
Nov 06 06:35:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:19 user nova-compute[74903]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 (non-flash)
Nov 06 06:35:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa4abef1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[762439b1-1d0d-4543-b0fa-be48960fd9e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f64e46-ba44-469d-a93b-97eed744dbb9]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3768ddb4-86b0-4ecb-bf9b-666293e17f8d]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad1e887-7e01-4350-94cd-3d46757c89a4]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7ab280db-5c6b9d2978def3e5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ab280db', '/dev/disk/by-id/scsi-23563366239643239') {{(pid=86748) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ceea7d-780d-4fd9-9c32-2bce8b882b2d]: (4, None) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[957b6b80-8b99-4b21-be1f-78b2ef83e108]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c87441c-f044-43e7-84bc-56c63c8ea932]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260]
Nov 06 06:35:19 user nova-compute[74903]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598, portal: 172.16.0.220,3260] successful.
Nov 06 06:35:19 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56f3df0-5011-41a2-a436-a71bbf605598 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1863f-8653-4614-8b5d-63e39d7fa9e5]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (340ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:35:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Deleting instance files /opt/stack/data/nova/instances/bb9804de-365f-4781-b464-21f3767a59d7_del
Nov 06 06:35:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Deletion of /opt/stack/data/nova/instances/bb9804de-365f-4781-b464-21f3767a59d7_del complete
Nov 06 06:35:19 user nova-compute[74903]: INFO nova.compute.manager [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing instance network info cache due to event network-changed-16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] Acquiring lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] Acquired lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:35:19 user nova-compute[74903]: DEBUG nova.network.neutron [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Refreshing network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updated VIF entry in instance network info cache for port 16e11ed7-9a0c-4260-b326-1257e09a7bbb. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.network.neutron [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating instance_info_cache with network_info: [{"id": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "address": "fa:16:3e:79:fc:90", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e11ed7-9a", "ovs_interfaceid": "16e11ed7-9a0c-4260-b326-1257e09a7bbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-dd05d51e-1346-405f-b0f5-ee7f53c3e0bc req-43926352-7f7d-452a-a3dc-22034e1f93ec service nova] Releasing lock "refresh_cache-bb9804de-365f-4781-b464-21f3767a59d7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:35:20 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Took 0.65 seconds to deallocate network for instance.
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:20 user nova-compute[74903]: WARNING nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state active and task_state deleting.
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:20 user nova-compute[74903]: WARNING nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state active and task_state deleting.
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:20 user nova-compute[74903]: WARNING nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state active and task_state deleting.
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-unplugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Acquiring lock "bb9804de-365f-4781-b464-21f3767a59d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] Lock "bb9804de-365f-4781-b464-21f3767a59d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] No waiting events found dispatching network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:35:20 user nova-compute[74903]: WARNING nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received unexpected event network-vif-plugged-16e11ed7-9a0c-4260-b326-1257e09a7bbb for instance with vm_state active and task_state deleting.
Nov 06 06:35:20 user nova-compute[74903]: DEBUG nova.compute.manager [req-b0b1eb9f-91ca-4481-808f-3b3e1ccdbb15 req-d0efaeff-ea09-441c-825e-f98608aa63bc service nova] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Received event network-vif-deleted-16e11ed7-9a0c-4260-b326-1257e09a7bbb {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:21 user nova-compute[74903]: INFO nova.compute.manager [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: bb9804de-365f-4781-b464-21f3767a59d7] Took 0.86 seconds to detach 1 volumes for instance.
Nov 06 06:35:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:21 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:35:21 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:35:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:21 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance bb9804de-365f-4781-b464-21f3767a59d7
Nov 06 06:35:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-3be60e0f-5b79-46bb-a109-21fac7db24aa tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "bb9804de-365f-4781-b464-21f3767a59d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:35:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:35:35 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:35:35 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:35:35 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a57e9e-96a4-4fb7-809d-a88195fca971]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:35:35 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001bfb2-ab3b-44be-b686-632c7f09bf08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f] added
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab5d9b-6985-4aef-acb0-413f998a1001]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6888557-797c-42fb-8331-0f7fc2e9eea9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkBCrXiG {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkBCrXiG" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a15c5-ed69-4059-b633-a77ec64ee7b4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkBCrXiG'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8df078-fc45-4205-a0ea-5c8e3af2e17e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5dfe7-09cd-4fee-a675-7912ee441121]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea42853-aae7-47bb-bac3-deed34f63aaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]
Nov 06 06:35:35 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f56f16-fd79-47e6-9469-e05d62f81ffe]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1356693-7313-4ba2-873c-9257d0670d82]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:35 user nova-compute[74903]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:35:35 user nova-compute[74903]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:35:35 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2cca77-c329-4696-90cc-e73b81737fe7]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:35:35 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26162353736663638', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162353736663638', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.objects.instance [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:35:36 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:35:36 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:35:36 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:35:36 user nova-compute[74903]:   <serial>a96c8320-d5e3-4627-b1bb-a2e45427647f</serial>
Nov 06 06:35:36 user nova-compute[74903]: </disk>
Nov 06 06:35:36 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No VIF found with MAC fa:16:3e:58:be:6f, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:35:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-75e9239c-c542-4f8f-82d4-b7bcea596101 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.143s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:37 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:35:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:35:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:35:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.12350082397461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:35:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:35:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:35:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG nova.compute.manager [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing instance network info cache due to event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated VIF entry in instance network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:35:57 user nova-compute[74903]: DEBUG nova.network.neutron [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:35:58 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-2cb23651-6d33-491a-b16d-d1dd90a42ba2 req-5a5117a6-a1dc-40ab-960c-1d837e4c49c3 service nova] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing instance network info cache due to event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:35:59 user nova-compute[74903]: DEBUG nova.network.neutron [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:36:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated VIF entry in instance network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:36:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a0fd4c80-d44f-46cd-88b2-98ad1ad10fbb req-c00fc11d-ec67-4333-9528-5ebc6d26b460 service nova] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:36:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:11 user nova-compute[74903]: INFO nova.compute.manager [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Rebooting instance
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:12 user nova-compute[74903]: WARNING nova.compute.manager [req-976c2afa-f104-4417-b868-0253d06c9969 req-f1d9cee6-5b66-472d-8d58-7025930b1a76 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance destroyed successfully.
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'resources' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:36:13Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4bb459b-b7, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60d96321-064b-46b6-81ac-1abfeb11ddf9) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:13 user nova-compute[74903]: INFO os_vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7')
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:36:13 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60fae58-6eb1-4cfd-ab5d-42f92804a4b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:36:13 user nova-compute[74903]: No targets found.
Nov 06 06:36:13 user nova-compute[74903]: iSNS:
Nov 06 06:36:13 user nova-compute[74903]: No targets found.
Nov 06 06:36:13 user nova-compute[74903]: STATIC:
Nov 06 06:36:13 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f
Nov 06 06:36:13 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:36:13 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:36:13 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:36:13 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:36:13 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:36:13 user nova-compute[74903]: FIRMWARE:
Nov 06 06:36:13 user nova-compute[74903]: No targets found.
Nov 06 06:36:13 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:36:13 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:36:13 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c2b4f-0665-4043-aa1b-e91b1ffcd52e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2d538-7542-43d5-852c-71db7e7464c2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:13 user nova-compute[74903]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:13 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:13 user nova-compute[74903]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:13 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa400f4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4099a-f87f-4e0a-8745-93e0daed7bb0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7443516d-bd7d-4126-969b-26d2fc6bc6ac]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99570f-2266-4bd1-b00c-f6cf81f8bba6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7e83c-8ca8-4e00-a94f-fde77f57c055]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7ffab-8940-4898-b5ae-d1e730d22f8c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c53558-931d-403a-a711-5cc81aa92321]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]
Nov 06 06:36:13 user nova-compute[74903]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.
Nov 06 06:36:13 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3687139f-329f-4d95-bcdf-2bae22b2a9e0]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== disconnect_volume: return (345ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start _get_guest_xml network_info=[{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=22e18dc8-2623-456a-ae8a-8ee5031035e7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '22e18dc8-2623-456a-ae8a-8ee5031035e7'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '55a06a00-0c79-4e71-92fb-27b88221e4c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a96c8320-d5e3-4627-b1bb-a2e45427647f', 'serial': 'a96c8320-d5e3-4627-b1bb-a2e45427647f'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'attachment_id': '009106c4-a0e8-4718-bbc3-6cc5e766ef58', 'volume_type': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:36:13 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:36:13 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=22e18dc8-2623-456a-ae8a-8ee5031035e7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.objects.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Object Instance<55a06a00-0c79-4e71-92fb-27b88221e4c7> lazy-loaded attributes: resources,vcpu_model {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:36:13 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:36:13 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:36:13 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46468b-cb3a-485d-827d-3b4bc05bdebe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:36:13 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[978e1d00-8674-422a-aca5-94d8314dd942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f] added
Nov 06 06:36:13 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e31c4-37dd-4d80-8ab4-950f77787b43]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:13 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df717a-7611-4856-88b3-66689918ffdd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkBCrXiG {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkBCrXiG" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[735943aa-372f-40d3-9e07-49739fd962e6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkBCrXiG'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ef3f6-76bb-48f4-8c72-1b85190f78cf]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d524970-f5ee-48ba-91af-20e87a1e05fe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e3c684-7a52-4bc1-a0c5-99531a816c00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]
Nov 06 06:36:14 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.
Nov 06 06:36:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dfff80-fdcb-4f55-a235-da772ea515a7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9773567-68bf-45ef-82ae-8c03fbfca304]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:14 user nova-compute[74903]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:14 user nova-compute[74903]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:14 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2be6c-e29e-4bba-9503-8c1048ca744b]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:14 user nova-compute[74903]: WARNING nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:14 user nova-compute[74903]: WARNING nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:14 user nova-compute[74903]: WARNING nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:14 user nova-compute[74903]: WARNING nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:14 user nova-compute[74903]: DEBUG nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:14 user nova-compute[74903]: WARNING nova.compute.manager [req-8f3c654f-f72d-4bf9-a04c-2a09f6c00c14 req-d93f63a7-1752-47f3-8227-0b7108df960e service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:15 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26162353736663638', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162353736663638', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:36:13Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'pci_devices' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.objects.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Object Instance<55a06a00-0c79-4e71-92fb-27b88221e4c7> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:36:15 user nova-compute[74903]:   <uuid>55a06a00-0c79-4e71-92fb-27b88221e4c7</uuid>
Nov 06 06:36:15 user nova-compute[74903]:   <name>instance-0000002f</name>
Nov 06 06:36:15 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:36:15 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:36:15 user nova-compute[74903]:   <metadata>
Nov 06 06:36:15 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:36:15 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:name>tempest-TestMinimumBasicScenario-server-334658449</nova:name>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:36:13</nova:creationTime>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:36:15 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:36:15 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:owner>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:user uuid="4438973277784443b1dcc671adaac185">tempest-TestMinimumBasicScenario-1990117235-project-member</nova:user>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:project uuid="46f674ff95744117a8e1e77c7d5953ba">tempest-TestMinimumBasicScenario-1990117235</nova:project>
Nov 06 06:36:15 user nova-compute[74903]:       </nova:owner>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:root type="image" uuid="22e18dc8-2623-456a-ae8a-8ee5031035e7"/>
Nov 06 06:36:15 user nova-compute[74903]:       <nova:ports>
Nov 06 06:36:15 user nova-compute[74903]:         <nova:port uuid="b4bb459b-b7db-453e-bdea-ee3047acde4d">
Nov 06 06:36:15 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 06:36:15 user nova-compute[74903]:         </nova:port>
Nov 06 06:36:15 user nova-compute[74903]:       </nova:ports>
Nov 06 06:36:15 user nova-compute[74903]:     </nova:instance>
Nov 06 06:36:15 user nova-compute[74903]:   </metadata>
Nov 06 06:36:15 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:36:15 user nova-compute[74903]:     <system>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="serial">55a06a00-0c79-4e71-92fb-27b88221e4c7</entry>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="uuid">55a06a00-0c79-4e71-92fb-27b88221e4c7</entry>
Nov 06 06:36:15 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:36:15 user nova-compute[74903]:     </system>
Nov 06 06:36:15 user nova-compute[74903]:   </sysinfo>
Nov 06 06:36:15 user nova-compute[74903]:   <os>
Nov 06 06:36:15 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:36:15 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:36:15 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:36:15 user nova-compute[74903]:   </os>
Nov 06 06:36:15 user nova-compute[74903]:   <features>
Nov 06 06:36:15 user nova-compute[74903]:     <acpi/>
Nov 06 06:36:15 user nova-compute[74903]:     <apic/>
Nov 06 06:36:15 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:36:15 user nova-compute[74903]:   </features>
Nov 06 06:36:15 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:36:15 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:36:15 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:36:15 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:36:15 user nova-compute[74903]:   </clock>
Nov 06 06:36:15 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:36:15 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:36:15 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:36:15 user nova-compute[74903]:   </cpu>
Nov 06 06:36:15 user nova-compute[74903]:   <devices>
Nov 06 06:36:15 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:36:15 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:36:15 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk"/>
Nov 06 06:36:15 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:36:15 user nova-compute[74903]:     </disk>
Nov 06 06:36:15 user nova-compute[74903]:     <disk type="block" device="disk">
Nov 06 06:36:15 user nova-compute[74903]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:36:15 user nova-compute[74903]:       <source dev="/dev/sdb"/>
Nov 06 06:36:15 user nova-compute[74903]:       <target dev="vdb" bus="virtio"/>
Nov 06 06:36:15 user nova-compute[74903]:       <serial>a96c8320-d5e3-4627-b1bb-a2e45427647f</serial>
Nov 06 06:36:15 user nova-compute[74903]:     </disk>
Nov 06 06:36:15 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:36:15 user nova-compute[74903]:       <mac address="fa:16:3e:58:be:6f"/>
Nov 06 06:36:15 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:36:15 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:36:15 user nova-compute[74903]:       <target dev="tapb4bb459b-b7"/>
Nov 06 06:36:15 user nova-compute[74903]:     </interface>
Nov 06 06:36:15 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:36:15 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/console.log" append="off"/>
Nov 06 06:36:15 user nova-compute[74903]:     </serial>
Nov 06 06:36:15 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:36:15 user nova-compute[74903]:     <video>
Nov 06 06:36:15 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:36:15 user nova-compute[74903]:     </video>
Nov 06 06:36:15 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:36:15 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:36:15 user nova-compute[74903]:     </rng>
Nov 06 06:36:15 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:36:15 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:36:15 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:36:15 user nova-compute[74903]:     </memballoon>
Nov 06 06:36:15 user nova-compute[74903]:   </devices>
Nov 06 06:36:15 user nova-compute[74903]: </domain>
Nov 06 06:36:15 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.objects.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Object Instance<55a06a00-0c79-4e71-92fb-27b88221e4c7> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c235120a6a1bc564c89a843b6f2b0ffd8a79d757 --force-share --output=json" returned: 0 in 0.170s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:36:15 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Cannot resize image /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'migration_context' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.objects.base [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Object Instance<55a06a00-0c79-4e71-92fb-27b88221e4c7> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74903) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:36:13Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG os_vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30129baf-f275-5f3e-93f1-837288975b79', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4bb459b-b7, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4bb459b-b7, col_values=(('qos', UUID('6e15d835-6d55-4aae-8887-ddf96198e768')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4bb459b-b7, col_values=(('external_ids', {'iface-id': 'b4bb459b-b7db-453e-bdea-ee3047acde4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:be:6f', 'vm-uuid': '55a06a00-0c79-4e71-92fb-27b88221e4c7'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:16 user nova-compute[74903]: INFO os_vif [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7')
Nov 06 06:36:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:17 user nova-compute[74903]: WARNING nova.compute.manager [req-216d9fd9-5ce0-4143-a46a-3ce4bd9a853b req-4ee4d3e2-3021-4b10-9d57-4cf7325123cb service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state reboot_started_hard.
Nov 06 06:36:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:36:19 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance rebooted successfully.
Nov 06 06:36:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6ac48daa-7a27-4e9f-84c4-3442151710e6 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.753s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:19 user nova-compute[74903]: WARNING nova.compute.manager [req-d9c7883f-0234-40bc-b4f9-b2907609d38c req-bee65352-bc59-4697-9168-d9c788af04af service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state active and task_state None.
Nov 06 06:36:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing instance network info cache due to event network-changed-24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] Acquiring lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] Acquired lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:36:31 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Refreshing network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:32 user nova-compute[74903]: INFO nova.compute.manager [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Terminating instance
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updated VIF entry in instance network info cache for port 24b109b5-3d36-4513-83d8-c9d5f09eb4e5. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.network.neutron [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [{"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c8511d85-64f1-4f2a-99f8-c7b2e9d68952 req-a4057ffd-76de-43ff-8bd4-d41c2fce24f1 service nova] Releasing lock "refresh_cache-c316d330-f6d9-4a5c-970a-e5c8446f9aa3" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Instance destroyed successfully.
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.objects.instance [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lazy-loading 'resources' on Instance uuid c316d330-f6d9-4a5c-970a-e5c8446f9aa3 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:31:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1274916640',display_name='tempest-TestVolumeBootPattern-server-1274916640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1274916640',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONzkN/lJd5plseSX9YZo+uvFuaI+bgqLpREGB5QqGnLCPJN/DxcaN3j5f1BSLNasNdFOCPZWLZ9VuBqtaXwkQstmMcJy8131Id/zEkoF9NUTZCOAyss8iYJ6eASmFj6DQ==',key_name='tempest-TestVolumeBootPattern-805966472',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4ca8acfbfb24a858078fcd5fd25f2fe',ramdisk_id='',reservation_id='r-x52kzrdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-251399615',owner_user_name='tempest-TestVolumeBootPattern-251399615-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:31:35Z,user_data=None,user_id='e598c1904d5b476098cfa01d389dd816',uuid=c316d330-f6d9-4a5c-970a-e5c8446f9aa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converting VIF {"id": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "address": "fa:16:3e:e9:1c:70", "network": {"id": "435065e8-2030-4f2c-a7bd-4042653436ab", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1779904765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4ca8acfbfb24a858078fcd5fd25f2fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24b109b5-3d", "ovs_interfaceid": "24b109b5-3d36-4513-83d8-c9d5f09eb4e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_vif [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24b109b5-3d, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b35d971a-64e4-46ab-abe2-8fd68f451d9e) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:32 user nova-compute[74903]: INFO os_vif [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:1c:70,bridge_name='br-int',has_traffic_filtering=True,id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5,network=Network(435065e8-2030-4f2c-a7bd-4042653436ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24b109b5-3d')
Nov 06 06:36:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lLzqocDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:36:32 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[44094a92-9cd8-44b6-a664-4b080a02cab3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:36:32 user nova-compute[74903]: No targets found.
Nov 06 06:36:32 user nova-compute[74903]: iSNS:
Nov 06 06:36:32 user nova-compute[74903]: No targets found.
Nov 06 06:36:32 user nova-compute[74903]: STATIC:
Nov 06 06:36:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f
Nov 06 06:36:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:36:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:36:32 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838
Nov 06 06:36:32 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:36:32 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:36:32 user nova-compute[74903]: FIRMWARE:
Nov 06 06:36:32 user nova-compute[74903]: No targets found.
Nov 06 06:36:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:36:32 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:36:32 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aa35ba-c7fb-4013-945a-0d7c8a3c79a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[675852df-7ded-4241-becf-00f63bbcec1a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:32 user nova-compute[74903]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 (non-flash)
Nov 06 06:36:32 user nova-compute[74903]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:36:32 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa085b7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838'): ({'sdd'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Removing single pathed devices sdd {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[706dd90c-df70-44bc-9155-92bbb05d11df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[402ca887-bd9d-4dc4-a6b4-213daf2b862c]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Flushing IO for device /dev/sdd {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:36:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfec73a0-835a-440f-b7e5-37986fd859c6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[af117261-1f94-407b-b74d-05ac30bbda27]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] SCSI volumes sdd have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9dc93d-58ca-48ce-aacb-8d74862a3b36]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f84b2-8961-4e47-b059-d33657bc2153]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260]
Nov 06 06:36:33 user nova-compute[74903]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838, portal: 172.16.0.220,3260] successful.
Nov 06 06:36:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8822c4f-27ad-4fef-b9ef-c869438e2838 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48d532-363f-4405-82d1-53510ae9cd7b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] <== disconnect_volume: return (310ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:36:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Deleting instance files /opt/stack/data/nova/instances/c316d330-f6d9-4a5c-970a-e5c8446f9aa3_del
Nov 06 06:36:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Deletion of /opt/stack/data/nova/instances/c316d330-f6d9-4a5c-970a-e5c8446f9aa3_del complete
Nov 06 06:36:33 user nova-compute[74903]: INFO nova.compute.manager [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:33 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Took 0.44 seconds to deallocate network for instance.
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-b318d8ea-7f2e-406e-80b1-0f367733faf9 req-355cb07e-9ab3-4bf9-9e2b-a320ca3d6e4f service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-deleted-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:33 user nova-compute[74903]: INFO nova.compute.manager [req-b318d8ea-7f2e-406e-80b1-0f367733faf9 req-355cb07e-9ab3-4bf9-9e2b-a320ca3d6e4f service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Neutron deleted interface 24b109b5-3d36-4513-83d8-c9d5f09eb4e5; detaching it from the instance and deleting it from the info cache
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-b318d8ea-7f2e-406e-80b1-0f367733faf9 req-355cb07e-9ab3-4bf9-9e2b-a320ca3d6e4f service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-b318d8ea-7f2e-406e-80b1-0f367733faf9 req-355cb07e-9ab3-4bf9-9e2b-a320ca3d6e4f service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Detach interface failed, port_id=24b109b5-3d36-4513-83d8-c9d5f09eb4e5, reason: Instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-unplugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] No waiting events found dispatching network-vif-unplugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-unplugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Acquiring lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] No waiting events found dispatching network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:36:34 user nova-compute[74903]: WARNING nova.compute.manager [req-81621be7-534d-41b5-9743-05ce180c430c req-3683555f-c342-472d-96ce-a7c0416bb4e0 service nova] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Received unexpected event network-vif-plugged-24b109b5-3d36-4513-83d8-c9d5f09eb4e5 for instance with vm_state active and task_state deleting.
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:36:34 user nova-compute[74903]: INFO nova.compute.manager [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] [instance: c316d330-f6d9-4a5c-970a-e5c8446f9aa3] Took 0.89 seconds to detach 1 volumes for instance.
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:34 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Deleted allocations for instance c316d330-f6d9-4a5c-970a-e5c8446f9aa3
Nov 06 06:36:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-bf8c4224-720c-4875-909f-a4dbff3a43d1 tempest-TestVolumeBootPattern-251399615 tempest-TestVolumeBootPattern-251399615-project-member] Lock "c316d330-f6d9-4a5c-970a-e5c8446f9aa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:35 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:36:35 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:36:35 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:36:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:36:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:45 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:36:47 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:36:48 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8863MB free_disk=25.112407684326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:36:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:36:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:36:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:55 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:36:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:09 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:09 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:37:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:19 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:37:19 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:37:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:37:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:37:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:37:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:37:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:37:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:37:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:37:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.109771728515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:37:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:37:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:37:55 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:37:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:38:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing instance network info cache due to event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:38:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:38:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:38:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated VIF entry in instance network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a4e142de-21ad-4ebd-ac57-0ad5272167c1 req-8b299908-41d4-4a3e-9da1-2aad2bf5c944 service nova] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing instance network info cache due to event network-changed-b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:38:05 user nova-compute[74903]: DEBUG nova.network.neutron [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Refreshing network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:06 user nova-compute[74903]: INFO nova.compute.manager [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Detaching volume a96c8320-d5e3-4627-b1bb-a2e45427647f
Nov 06 06:38:06 user nova-compute[74903]: INFO nova.virt.block_device [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Attempting to driver detach volume a96c8320-d5e3-4627-b1bb-a2e45427647f from mountpoint /dev/vdb
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Attempting to detach device vdb from instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:38:06 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:38:06 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:38:06 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:38:06 user nova-compute[74903]:   <serial>a96c8320-d5e3-4627-b1bb-a2e45427647f</serial>
Nov 06 06:38:06 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:38:06 user nova-compute[74903]: </disk>
Nov 06 06:38:06 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:38:06 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully detached device vdb from instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 from the persistent domain config.
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:38:06 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:38:06 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:38:06 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:38:06 user nova-compute[74903]:   <serial>a96c8320-d5e3-4627-b1bb-a2e45427647f</serial>
Nov 06 06:38:06 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 06:38:06 user nova-compute[74903]: </disk>
Nov 06 06:38:06 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated VIF entry in instance network info cache for port b4bb459b-b7db-453e-bdea-ee3047acde4d. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.network.neutron [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-395a5bfd-0622-49f1-96a3-f4542a6f3873 req-e434667e-cde3-45fc-b932-31282b3b6bae service nova] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:38:06 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:38:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:38:20 user nova-compute[74903]: INFO nova.compute.claims [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Claim successful on node user
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:38:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:38:20 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Creating image(s)
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "/opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "/opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG nova.policy [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1e4491ac2bd4db0b7a9111b0fc0d3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197dd0fa03c14b4aa6c662473a2bc773', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:20 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk 1073741824" returned: 0 in 0.053s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.192s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Successfully created port: 405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Cannot resize image /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Ensure instance console log exists: /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:21 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Successfully updated port: 405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquired lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-changed-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Refreshing instance network info cache due to event network-changed-405d9cb4-ef72-431f-b188-497690b6240e. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] Acquiring lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.neutron [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updating instance_info_cache with network_info: [{"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Releasing lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Instance network_info: |[{"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] Acquired lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Refreshing network info cache for port 405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Start _get_guest_xml network_info=[{"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:38:22 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:38:22 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-685865973',display_name='tempest-VolumesNegativeTest-instance-685865973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-685865973',id=49,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='197dd0fa03c14b4aa6c662473a2bc773',ramdisk_id='',reservation_id='r-kginx76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-375569908',owner_user_name='tempest-VolumesNegativeTest-375569908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:38:21Z,user_data=None,user_id='a1e4491ac2bd4db0b7a9111b0fc0d3c9',uuid=5a6e4aee-b6f5-477b-8679-cdd490c53804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converting VIF {"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a6e4aee-b6f5-477b-8679-cdd490c53804 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:38:22 user nova-compute[74903]:   <uuid>5a6e4aee-b6f5-477b-8679-cdd490c53804</uuid>
Nov 06 06:38:22 user nova-compute[74903]:   <name>instance-00000031</name>
Nov 06 06:38:22 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:38:22 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:38:22 user nova-compute[74903]:   <metadata>
Nov 06 06:38:22 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:38:22 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:name>tempest-VolumesNegativeTest-instance-685865973</nova:name>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:38:22</nova:creationTime>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:38:22 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:38:22 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:owner>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:user uuid="a1e4491ac2bd4db0b7a9111b0fc0d3c9">tempest-VolumesNegativeTest-375569908-project-member</nova:user>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:project uuid="197dd0fa03c14b4aa6c662473a2bc773">tempest-VolumesNegativeTest-375569908</nova:project>
Nov 06 06:38:22 user nova-compute[74903]:       </nova:owner>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:38:22 user nova-compute[74903]:       <nova:ports>
Nov 06 06:38:22 user nova-compute[74903]:         <nova:port uuid="405d9cb4-ef72-431f-b188-497690b6240e">
Nov 06 06:38:22 user nova-compute[74903]:           <nova:ip type="fixed" address="192.168.233.108" ipVersion="4"/>
Nov 06 06:38:22 user nova-compute[74903]:         </nova:port>
Nov 06 06:38:22 user nova-compute[74903]:       </nova:ports>
Nov 06 06:38:22 user nova-compute[74903]:     </nova:instance>
Nov 06 06:38:22 user nova-compute[74903]:   </metadata>
Nov 06 06:38:22 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:38:22 user nova-compute[74903]:     <system>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="serial">5a6e4aee-b6f5-477b-8679-cdd490c53804</entry>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="uuid">5a6e4aee-b6f5-477b-8679-cdd490c53804</entry>
Nov 06 06:38:22 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:38:22 user nova-compute[74903]:     </system>
Nov 06 06:38:22 user nova-compute[74903]:   </sysinfo>
Nov 06 06:38:22 user nova-compute[74903]:   <os>
Nov 06 06:38:22 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:38:22 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:38:22 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:38:22 user nova-compute[74903]:   </os>
Nov 06 06:38:22 user nova-compute[74903]:   <features>
Nov 06 06:38:22 user nova-compute[74903]:     <acpi/>
Nov 06 06:38:22 user nova-compute[74903]:     <apic/>
Nov 06 06:38:22 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:38:22 user nova-compute[74903]:   </features>
Nov 06 06:38:22 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:38:22 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:38:22 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:38:22 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:38:22 user nova-compute[74903]:   </clock>
Nov 06 06:38:22 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:38:22 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:38:22 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:38:22 user nova-compute[74903]:   </cpu>
Nov 06 06:38:22 user nova-compute[74903]:   <devices>
Nov 06 06:38:22 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:38:22 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:38:22 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk"/>
Nov 06 06:38:22 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:38:22 user nova-compute[74903]:     </disk>
Nov 06 06:38:22 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:38:22 user nova-compute[74903]:       <mac address="fa:16:3e:68:f7:c7"/>
Nov 06 06:38:22 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:38:22 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:38:22 user nova-compute[74903]:       <target dev="tap405d9cb4-ef"/>
Nov 06 06:38:22 user nova-compute[74903]:     </interface>
Nov 06 06:38:22 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:38:22 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/console.log" append="off"/>
Nov 06 06:38:22 user nova-compute[74903]:     </serial>
Nov 06 06:38:22 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:38:22 user nova-compute[74903]:     <video>
Nov 06 06:38:22 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:38:22 user nova-compute[74903]:     </video>
Nov 06 06:38:22 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:38:22 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:38:22 user nova-compute[74903]:     </rng>
Nov 06 06:38:22 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:38:22 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:38:22 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:38:22 user nova-compute[74903]:     </memballoon>
Nov 06 06:38:22 user nova-compute[74903]:   </devices>
Nov 06 06:38:22 user nova-compute[74903]: </domain>
Nov 06 06:38:22 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-685865973',display_name='tempest-VolumesNegativeTest-instance-685865973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-685865973',id=49,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='197dd0fa03c14b4aa6c662473a2bc773',ramdisk_id='',reservation_id='r-kginx76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-375569908',owner_user_name='tempest-VolumesNegativeTest-375569908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:38:21Z,user_data=None,user_id='a1e4491ac2bd4db0b7a9111b0fc0d3c9',uuid=5a6e4aee-b6f5-477b-8679-cdd490c53804,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converting VIF {"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG os_vif [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6567ddc-eba3-5a52-a9e1-9f3c00ae3cbe', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405d9cb4-ef, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap405d9cb4-ef, col_values=(('qos', UUID('7ea5ff84-c457-4534-93d1-f5f3e46ab0bb')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap405d9cb4-ef, col_values=(('external_ids', {'iface-id': '405d9cb4-ef72-431f-b188-497690b6240e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f7:c7', 'vm-uuid': '5a6e4aee-b6f5-477b-8679-cdd490c53804'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:38:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:22 user nova-compute[74903]: INFO os_vif [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef')
Nov 06 06:38:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:38:23 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] No VIF found with MAC fa:16:3e:68:f7:c7, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:38:23 user nova-compute[74903]: DEBUG nova.network.neutron [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updated VIF entry in instance network info cache for port 405d9cb4-ef72-431f-b188-497690b6240e. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:38:23 user nova-compute[74903]: DEBUG nova.network.neutron [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updating instance_info_cache with network_info: [{"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:38:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-636f18dc-7fd9-420a-a452-8310cbe63b77 req-48d343e0-fc56-4a12-92b3-e638384a4ce6 service nova] Releasing lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG nova.compute.manager [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] No waiting events found dispatching network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:38:24 user nova-compute[74903]: WARNING nova.compute.manager [req-22521480-4b9a-4c0e-aa41-c80bf32ef098 req-c16c18d2-1400-42c6-9bd7-f6517cd64c39 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received unexpected event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e for instance with vm_state building and task_state spawning.
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:38:26 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Instance spawned successfully.
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:38:26 user nova-compute[74903]: INFO nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:38:26 user nova-compute[74903]: INFO nova.compute.manager [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Took 6.35 seconds to build instance.
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.compute.manager [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] No waiting events found dispatching network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:38:26 user nova-compute[74903]: WARNING nova.compute.manager [req-c49fc4d4-73f3-4b37-9e83-c0c6160aeb26 req-b36002dd-61d6-4d66-8a60-690ef97a9991 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received unexpected event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e for instance with vm_state active and task_state None.
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5921c92d-b616-4c2f-adf9-1dc73635a701 tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.454s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:26 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 is timed out.
Nov 06 06:38:26 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully detached device vdb from instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 from the live domain config.
Nov 06 06:38:26 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkBCrXiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:38:26 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b09825f-e84a-4b04-b87f-8303943ac620]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:38:26 user nova-compute[74903]: No targets found.
Nov 06 06:38:26 user nova-compute[74903]: iSNS:
Nov 06 06:38:26 user nova-compute[74903]: No targets found.
Nov 06 06:38:26 user nova-compute[74903]: STATIC:
Nov 06 06:38:26 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f
Nov 06 06:38:26 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:38:26 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:38:26 user nova-compute[74903]: FIRMWARE:
Nov 06 06:38:26 user nova-compute[74903]: No targets found.
Nov 06 06:38:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:38:26 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:38:26 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[91517c3f-85dc-4b02-b7a3-69f85104ce80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6e633-ec61-4206-9807-d41195fbf454]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:38:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f (non-flash)
Nov 06 06:38:26 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa084acca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46b9f2-0fa1-4eba-9355-aaa38adf6663]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1023d5-ac15-470f-825d-77b4086a1692]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1e82c8-b9d0-4c0a-8f60-d0327ec8d566]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b00777-98ea-42c0-9e12-1dacd3277dd1]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac9b55a-c913-4f05-a616-d992b7779c8e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:38:26 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde86f1-5bd5-4e7e-81f7-565e2d5cc9c3]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260]
Nov 06 06:38:27 user nova-compute[74903]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f, portal: 172.16.0.220,3260] successful.
Nov 06 06:38:27 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96c8320-d5e3-4627-b1bb-a2e45427647f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f94d6-63b5-4b26-9e9f-788a2ef70e85]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== disconnect_volume: return (280ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG nova.objects.instance [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:27 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-2f766ab5-1c0f-46b4-9fc3-afc481302ec5 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [{"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-55a06a00-0c79-4e71-92fb-27b88221e4c7" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:38:38 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:38:40 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:41 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:41 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:38:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:38:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:38:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=25.08032989501953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 55a06a00-0c79-4e71-92fb-27b88221e4c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5a6e4aee-b6f5-477b-8679-cdd490c53804 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:38:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:38:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:57 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:57 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:38:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:38:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:07 user nova-compute[74903]: INFO nova.compute.manager [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Terminating instance
Nov 06 06:39:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ab075dd-3b44-4a1a-a168-317bc7638d51 req-01c3dae9-0eac-4025-a644-573ed138b267 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-unplugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Instance destroyed successfully.
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'resources' on Instance uuid 55a06a00-0c79-4e71-92fb-27b88221e4c7 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-334658449',display_name='tempest-TestMinimumBasicScenario-server-334658449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-334658449',id=47,image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNS4DvhlvMXBaHPHVS6RHRJrvqG6xdeXy7S9F7LwEktqfeoskftFlBb657P6Ws1xw4njYgauGVbO+rv6/pFEsbLAuqT0b7LSAAjhTPM69MDkvV4h2PbaJz1WBQHULBRGg==',key_name='tempest-TestMinimumBasicScenario-1764602240',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:32:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-o4pnf25q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='22e18dc8-2623-456a-ae8a-8ee5031035e7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:36:20Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=55a06a00-0c79-4e71-92fb-27b88221e4c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "address": "fa:16:3e:58:be:6f", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4bb459b-b7", "ovs_interfaceid": "b4bb459b-b7db-453e-bdea-ee3047acde4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG os_vif [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4bb459b-b7, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e15d835-6d55-4aae-8887-ddf96198e768) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:08 user nova-compute[74903]: INFO os_vif [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:be:6f,bridge_name='br-int',has_traffic_filtering=True,id=b4bb459b-b7db-453e-bdea-ee3047acde4d,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4bb459b-b7')
Nov 06 06:39:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Deleting instance files /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7_del
Nov 06 06:39:08 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Deletion of /opt/stack/data/nova/instances/55a06a00-0c79-4e71-92fb-27b88221e4c7_del complete
Nov 06 06:39:08 user nova-compute[74903]: INFO nova.compute.manager [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:39:08 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:39:08 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Took 0.58 seconds to deallocate network for instance.
Nov 06 06:39:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:39:08 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:09 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Deleted allocations for instance 55a06a00-0c79-4e71-92fb-27b88221e4c7
Nov 06 06:39:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a99a0b92-04be-43d1-a4e3-00d7139f1e8d tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.760s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:39:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] Acquiring lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:09 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] Lock "55a06a00-0c79-4e71-92fb-27b88221e4c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] No waiting events found dispatching network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:39:09 user nova-compute[74903]: WARNING nova.compute.manager [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received unexpected event network-vif-plugged-b4bb459b-b7db-453e-bdea-ee3047acde4d for instance with vm_state deleted and task_state None.
Nov 06 06:39:09 user nova-compute[74903]: DEBUG nova.compute.manager [req-6151511a-cbfb-4268-9d83-a8e0612f6f2b req-f62c2336-ff5f-470b-a1e9-aa75b8826082 service nova] [instance: 55a06a00-0c79-4e71-92fb-27b88221e4c7] Received event network-vif-deleted-b4bb459b-b7db-453e-bdea-ee3047acde4d {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:39:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updating instance_info_cache with network_info: [{"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-5a6e4aee-b6f5-477b-8679-cdd490c53804" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:39:40 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:39:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:39:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:39:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:39:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:39:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:39:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8931MB free_disk=25.10582733154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 5a6e4aee-b6f5-477b-8679-cdd490c53804 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:39:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:39:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:39:58 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:39:59 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:40:01 user nova-compute[74903]: INFO nova.compute.claims [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Claim successful on node user
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:40:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.policy [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4438973277784443b1dcc671adaac185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f674ff95744117a8e1e77c7d5953ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:40:01 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Creating image(s)
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "/opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "/opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "/opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:01 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG nova.virt.images [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] 77cca7d9-a26c-43bc-b37a-a90ba5bd83fc was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.part /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Successfully created port: 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.part /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.converted" returned: 0 in 0.239s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.994s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:02 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json" returned: 0 in 0.183s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json" returned: 0 in 0.279s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a,backing_fmt=raw /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Successfully updated port: 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.compute.manager [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing instance network info cache due to event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a,backing_fmt=raw /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk 1073741824" returned: 0 in 0.064s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "6bb4ec49f1b5a81ab0169e45fb993d54921f100a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bb4ec49f1b5a81ab0169e45fb993d54921f100a --force-share --output=json" returned: 0 in 0.169s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-330e8698-0595-4772-9026-8a746aef9bdc req-95124714-a056-4965-904c-8182ddf68050 service nova] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Cannot resize image /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Ensure instance console log exists: /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:03 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.network.neutron [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance network_info: |[{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Start _get_guest_xml network_info=[{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T06:39:59Z,direct_url=<?>,disk_format='qcow2',id=77cca7d9-a26c-43bc-b37a-a90ba5bd83fc,min_disk=0,min_ram=0,name='tempest-scenario-img--1179823285',owner='46f674ff95744117a8e1e77c7d5953ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T06:40:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '77cca7d9-a26c-43bc-b37a-a90ba5bd83fc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:40:04 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:40:04 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T06:39:59Z,direct_url=<?>,disk_format='qcow2',id=77cca7d9-a26c-43bc-b37a-a90ba5bd83fc,min_disk=0,min_ram=0,name='tempest-scenario-img--1179823285',owner='46f674ff95744117a8e1e77c7d5953ba',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T06:40:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1925980554',display_name='tempest-TestMinimumBasicScenario-server-1925980554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1925980554',id=50,image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOtdDUY/aMktU7xrxqxbu0kU3ken1UmjI/TQYlQtqVW/3n+qWHazUv2TFRvqAJFjStk5/+ZfQulMs6imfIa3D2b/D6KVILU3aJ20nC6NybJsveQX529mpqsNfx3zIu9rg==',key_name='tempest-TestMinimumBasicScenario-80218171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-8v3zm0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:40:02Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=aab1da5d-ecd4-4263-a3da-e293118c7051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.objects.instance [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'pci_devices' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:40:04 user nova-compute[74903]:   <uuid>aab1da5d-ecd4-4263-a3da-e293118c7051</uuid>
Nov 06 06:40:04 user nova-compute[74903]:   <name>instance-00000032</name>
Nov 06 06:40:04 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:40:04 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:40:04 user nova-compute[74903]:   <metadata>
Nov 06 06:40:04 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:40:04 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:name>tempest-TestMinimumBasicScenario-server-1925980554</nova:name>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:40:04</nova:creationTime>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:40:04 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:40:04 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:owner>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:user uuid="4438973277784443b1dcc671adaac185">tempest-TestMinimumBasicScenario-1990117235-project-member</nova:user>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:project uuid="46f674ff95744117a8e1e77c7d5953ba">tempest-TestMinimumBasicScenario-1990117235</nova:project>
Nov 06 06:40:04 user nova-compute[74903]:       </nova:owner>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:root type="image" uuid="77cca7d9-a26c-43bc-b37a-a90ba5bd83fc"/>
Nov 06 06:40:04 user nova-compute[74903]:       <nova:ports>
Nov 06 06:40:04 user nova-compute[74903]:         <nova:port uuid="8506e7fe-a38d-4c3e-a0ff-66a279de81ea">
Nov 06 06:40:04 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 06:40:04 user nova-compute[74903]:         </nova:port>
Nov 06 06:40:04 user nova-compute[74903]:       </nova:ports>
Nov 06 06:40:04 user nova-compute[74903]:     </nova:instance>
Nov 06 06:40:04 user nova-compute[74903]:   </metadata>
Nov 06 06:40:04 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:40:04 user nova-compute[74903]:     <system>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="serial">aab1da5d-ecd4-4263-a3da-e293118c7051</entry>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="uuid">aab1da5d-ecd4-4263-a3da-e293118c7051</entry>
Nov 06 06:40:04 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:40:04 user nova-compute[74903]:     </system>
Nov 06 06:40:04 user nova-compute[74903]:   </sysinfo>
Nov 06 06:40:04 user nova-compute[74903]:   <os>
Nov 06 06:40:04 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:40:04 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:40:04 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:40:04 user nova-compute[74903]:   </os>
Nov 06 06:40:04 user nova-compute[74903]:   <features>
Nov 06 06:40:04 user nova-compute[74903]:     <acpi/>
Nov 06 06:40:04 user nova-compute[74903]:     <apic/>
Nov 06 06:40:04 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:40:04 user nova-compute[74903]:   </features>
Nov 06 06:40:04 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:40:04 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:40:04 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:40:04 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:40:04 user nova-compute[74903]:   </clock>
Nov 06 06:40:04 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:40:04 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:40:04 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:40:04 user nova-compute[74903]:   </cpu>
Nov 06 06:40:04 user nova-compute[74903]:   <devices>
Nov 06 06:40:04 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:40:04 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:40:04 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk"/>
Nov 06 06:40:04 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:40:04 user nova-compute[74903]:     </disk>
Nov 06 06:40:04 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:40:04 user nova-compute[74903]:       <mac address="fa:16:3e:88:f4:31"/>
Nov 06 06:40:04 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:40:04 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:40:04 user nova-compute[74903]:       <target dev="tap8506e7fe-a3"/>
Nov 06 06:40:04 user nova-compute[74903]:     </interface>
Nov 06 06:40:04 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:40:04 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/console.log" append="off"/>
Nov 06 06:40:04 user nova-compute[74903]:     </serial>
Nov 06 06:40:04 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:40:04 user nova-compute[74903]:     <video>
Nov 06 06:40:04 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:40:04 user nova-compute[74903]:     </video>
Nov 06 06:40:04 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:40:04 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:40:04 user nova-compute[74903]:     </rng>
Nov 06 06:40:04 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:40:04 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:40:04 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:40:04 user nova-compute[74903]:     </memballoon>
Nov 06 06:40:04 user nova-compute[74903]:   </devices>
Nov 06 06:40:04 user nova-compute[74903]: </domain>
Nov 06 06:40:04 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1925980554',display_name='tempest-TestMinimumBasicScenario-server-1925980554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1925980554',id=50,image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOtdDUY/aMktU7xrxqxbu0kU3ken1UmjI/TQYlQtqVW/3n+qWHazUv2TFRvqAJFjStk5/+ZfQulMs6imfIa3D2b/D6KVILU3aJ20nC6NybJsveQX529mpqsNfx3zIu9rg==',key_name='tempest-TestMinimumBasicScenario-80218171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-8v3zm0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:40:02Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=aab1da5d-ecd4-4263-a3da-e293118c7051,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG os_vif [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a146cf52-0579-502f-9113-c9a683e8877f', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8506e7fe-a3, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8506e7fe-a3, col_values=(('qos', UUID('f0f63293-eedc-481a-a6ec-b037d8ce24ec')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8506e7fe-a3, col_values=(('external_ids', {'iface-id': '8506e7fe-a38d-4c3e-a0ff-66a279de81ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:f4:31', 'vm-uuid': 'aab1da5d-ecd4-4263-a3da-e293118c7051'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:04 user nova-compute[74903]: INFO os_vif [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3')
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:40:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No VIF found with MAC fa:16:3e:88:f4:31, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:40:05 user nova-compute[74903]: WARNING nova.compute.manager [req-831e974d-5609-4d71-9955-366ef824f28d req-cd6fd356-be10-41a4-8064-1866e93c9077 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state building and task_state spawning.
Nov 06 06:40:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:40:07 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance spawned successfully.
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:40:07 user nova-compute[74903]: INFO nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:07 user nova-compute[74903]: DEBUG nova.compute.manager [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:40:07 user nova-compute[74903]: WARNING nova.compute.manager [req-54e03537-d55c-4689-96a0-f785511cadcb req-6a9f558a-2e5d-429d-9f92-e795a2de02ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state building and task_state spawning.
Nov 06 06:40:07 user nova-compute[74903]: INFO nova.compute.manager [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Took 6.46 seconds to build instance.
Nov 06 06:40:07 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-73bd84ac-3724-42d7-a5ca-36efd4bc7b3f tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.564s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:10 user nova-compute[74903]: INFO nova.compute.manager [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Terminating instance
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.compute.manager [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-unplugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] No waiting events found dispatching network-vif-unplugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.compute.manager [req-18b279bf-f8b3-4601-b9c5-ef5012c80768 req-c2e8af78-d633-4396-a0f9-3f4276c02c5f service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-unplugged-405d9cb4-ef72-431f-b188-497690b6240e for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:40:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Instance destroyed successfully.
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lazy-loading 'resources' on Instance uuid 5a6e4aee-b6f5-477b-8679-cdd490c53804 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-685865973',display_name='tempest-VolumesNegativeTest-instance-685865973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-685865973',id=49,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='197dd0fa03c14b4aa6c662473a2bc773',ramdisk_id='',reservation_id='r-kginx76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-375569908',owner_user_name='tempest-VolumesNegativeTest-375569908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:38:27Z,user_data=None,user_id='a1e4491ac2bd4db0b7a9111b0fc0d3c9',uuid=5a6e4aee-b6f5-477b-8679-cdd490c53804,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converting VIF {"id": "405d9cb4-ef72-431f-b188-497690b6240e", "address": "fa:16:3e:68:f7:c7", "network": {"id": "2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c165348a22774669bf5387d26ed71ec9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405d9cb4-ef", "ovs_interfaceid": "405d9cb4-ef72-431f-b188-497690b6240e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG os_vif [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405d9cb4-ef, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ea5ff84-c457-4534-93d1-f5f3e46ab0bb) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:10 user nova-compute[74903]: INFO os_vif [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f7:c7,bridge_name='br-int',has_traffic_filtering=True,id=405d9cb4-ef72-431f-b188-497690b6240e,network=Network(2f9b0ba2-0ce8-4275-961b-5ef4c8a70b27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405d9cb4-ef')
Nov 06 06:40:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Deleting instance files /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804_del
Nov 06 06:40:10 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Deletion of /opt/stack/data/nova/instances/5a6e4aee-b6f5-477b-8679-cdd490c53804_del complete
Nov 06 06:40:11 user nova-compute[74903]: INFO nova.compute.manager [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 06:40:11 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-efb168c9-e757-475a-a140-1196889e2ec0 req-444a20e9-9b90-4eac-8f61-93e495486a86 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-deleted-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:11 user nova-compute[74903]: INFO nova.compute.manager [req-efb168c9-e757-475a-a140-1196889e2ec0 req-444a20e9-9b90-4eac-8f61-93e495486a86 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Neutron deleted interface 405d9cb4-ef72-431f-b188-497690b6240e; detaching it from the instance and deleting it from the info cache
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.network.neutron [req-efb168c9-e757-475a-a140-1196889e2ec0 req-444a20e9-9b90-4eac-8f61-93e495486a86 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:40:11 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Took 0.58 seconds to deallocate network for instance.
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.compute.manager [req-efb168c9-e757-475a-a140-1196889e2ec0 req-444a20e9-9b90-4eac-8f61-93e495486a86 service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Detach interface failed, port_id=405d9cb4-ef72-431f-b188-497690b6240e, reason: Instance 5a6e4aee-b6f5-477b-8679-cdd490c53804 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:40:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:11 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Deleted allocations for instance 5a6e4aee-b6f5-477b-8679-cdd490c53804
Nov 06 06:40:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-44c9739a-7ac5-4c3e-bddb-f52e1728dc3a tempest-VolumesNegativeTest-375569908 tempest-VolumesNegativeTest-375569908-project-member] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.810s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] Acquiring lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] Lock "5a6e4aee-b6f5-477b-8679-cdd490c53804-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:12 user nova-compute[74903]: DEBUG nova.compute.manager [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] No waiting events found dispatching network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:40:12 user nova-compute[74903]: WARNING nova.compute.manager [req-fab962b8-0564-4252-b588-e7c2c82368a1 req-09e088bf-2039-41e3-9442-4b60552dd5bc service nova] [instance: 5a6e4aee-b6f5-477b-8679-cdd490c53804] Received unexpected event network-vif-plugged-405d9cb4-ef72-431f-b188-497690b6240e for instance with vm_state deleted and task_state None.
Nov 06 06:40:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:40:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:40:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:40:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:40:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:40:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:40:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:40:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.075233459472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance aab1da5d-ecd4-4263-a3da-e293118c7051 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:40:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:40:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:40:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:41:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:39 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:41:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:41:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:46 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:41:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:51 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:41:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:41:52 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.073657989501953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance aab1da5d-ecd4-4263-a3da-e293118c7051 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:41:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:41:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:41:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG nova.objects.instance [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:41:57 user nova-compute[74903]: INFO nova.compute.manager [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Attaching volume 55a98f73-a724-45a0-8007-6f720743c8cd to /dev/vdb
Nov 06 06:41:57 user nova-compute[74903]: DEBUG os_brick.utils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:41:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[73805b49-efbf-47bc-8b13-c78c2cde090a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[37127dee-ef65-486c-a482-dcfa26310e41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a65bd6-c2df-4168-950c-3211e8e2aad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e11251-4a05-4b04-bd2a-8029718ca7cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:41:58 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:41:58 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7e8f94-87f3-4b84-be89-0d12c455f5eb]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG os_brick.utils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:41:58 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating existing volume attachment record: 517a9ff6-7e22-49e7-9b77-c5bc736e53e5 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:42:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:42:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:06 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:42:11 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:15 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:42:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuYmEgzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:42:29 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:42:29 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:42:29 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d94a1f-d27f-48bc-b7b1-276b7fe978eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:42:29 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfe3856-8c92-42fa-acc5-b7f42e732ec9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd] added
Nov 06 06:42:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980cfb8-d5bc-41c4-a777-6689981e7805]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87620b-17c4-43e0-8be4-6cc68ec763c9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuYmEgzM {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wuYmEgzM" returned: 0 in 0.031s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e9592-f68f-45a8-8276-2aad7675fa2a]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wuYmEgzM'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b1de1-2a86-4a98-ac39-2a37b9c119b4]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f3429-1319-40ba-84e1-609b361e2268]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:42:29 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:42:29 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:42:29 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:42:29 user nova-compute[74903]: 
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[573024f5-607f-451b-af52-ad4e213ea7b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260]
Nov 06 06:42:29 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260] successful.
Nov 06 06:42:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cb3be6-57f4-4415-8e6e-4c38ab2c86a6]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb14a46-4c29-4b04-9e98-06e9fcca4864]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:42:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:42:29 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a2499-7e04-4a4f-9e01-9b6dd889eacc]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:42:29 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuYmEgzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:30 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:42:30 user nova-compute[74903]: INFO nova.compute.claims [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Claim successful on node user
Nov 06 06:42:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.606s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== connect_volume: return (1608ms) {'type': 'block', 'scsi_wwn': '23663626636363434', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663626636363434', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:42:31 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:42:31 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:42:31 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:42:31 user nova-compute[74903]:   <serial>55a98f73-a724-45a0-8007-6f720743c8cd</serial>
Nov 06 06:42:31 user nova-compute[74903]: </disk>
Nov 06 06:42:31 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:42:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.policy [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db792d563e55434f9eefcbf3c27aef9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7432b75dfcb43418153f5d4f5d7e617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:42:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Creating image(s)
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "/opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "/opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] No VIF found with MAC fa:16:3e:88:f4:31, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-eebb2ffe-ab25-4fec-bfe4-5334edfeeba2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.843s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.207s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk 1073741824" returned: 0 in 0.053s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "b6dc1b71a33048dfaa1347e252af6f874a36a4da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:31 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Successfully created port: 0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk. size=1073741824 {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.virt.disk.api [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Cannot resize image /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk to a smaller size. {{(pid=74903) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Ensure instance console log exists: /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Successfully updated port: 0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-changed-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.compute.manager [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing instance network info cache due to event network-changed-0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:32 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.neutron [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Instance network_info: |[{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing network info cache for port 0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Start _get_guest_xml network_info=[{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e8f85acc-7dce-4172-bf4e-a640a545c91b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:42:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:42:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T05:51:30Z,direct_url=<?>,disk_format='qcow2',id=e8f85acc-7dce-4172-bf4e-a640a545c91b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c165348a22774669bf5387d26ed71ec9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T05:51:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-956198586',display_name='tempest-TestStampPattern-server-956198586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-956198586',id=51,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-3u9lzw9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:42:31Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=7eedbb73-8439-487d-948e-3feb804c5508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.objects.instance [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:42:33 user nova-compute[74903]:   <uuid>7eedbb73-8439-487d-948e-3feb804c5508</uuid>
Nov 06 06:42:33 user nova-compute[74903]:   <name>instance-00000033</name>
Nov 06 06:42:33 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:42:33 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:42:33 user nova-compute[74903]:   <metadata>
Nov 06 06:42:33 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:42:33 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:name>tempest-TestStampPattern-server-956198586</nova:name>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:42:33</nova:creationTime>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:42:33 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:42:33 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:owner>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:user uuid="db792d563e55434f9eefcbf3c27aef9c">tempest-TestStampPattern-1392602142-project-member</nova:user>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:project uuid="d7432b75dfcb43418153f5d4f5d7e617">tempest-TestStampPattern-1392602142</nova:project>
Nov 06 06:42:33 user nova-compute[74903]:       </nova:owner>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:root type="image" uuid="e8f85acc-7dce-4172-bf4e-a640a545c91b"/>
Nov 06 06:42:33 user nova-compute[74903]:       <nova:ports>
Nov 06 06:42:33 user nova-compute[74903]:         <nova:port uuid="0927b105-d279-48a3-a741-9039d48fff80">
Nov 06 06:42:33 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 06:42:33 user nova-compute[74903]:         </nova:port>
Nov 06 06:42:33 user nova-compute[74903]:       </nova:ports>
Nov 06 06:42:33 user nova-compute[74903]:     </nova:instance>
Nov 06 06:42:33 user nova-compute[74903]:   </metadata>
Nov 06 06:42:33 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:42:33 user nova-compute[74903]:     <system>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="serial">7eedbb73-8439-487d-948e-3feb804c5508</entry>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="uuid">7eedbb73-8439-487d-948e-3feb804c5508</entry>
Nov 06 06:42:33 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:42:33 user nova-compute[74903]:     </system>
Nov 06 06:42:33 user nova-compute[74903]:   </sysinfo>
Nov 06 06:42:33 user nova-compute[74903]:   <os>
Nov 06 06:42:33 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:42:33 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:42:33 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:42:33 user nova-compute[74903]:   </os>
Nov 06 06:42:33 user nova-compute[74903]:   <features>
Nov 06 06:42:33 user nova-compute[74903]:     <acpi/>
Nov 06 06:42:33 user nova-compute[74903]:     <apic/>
Nov 06 06:42:33 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:42:33 user nova-compute[74903]:   </features>
Nov 06 06:42:33 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:42:33 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:42:33 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:42:33 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:42:33 user nova-compute[74903]:   </clock>
Nov 06 06:42:33 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:42:33 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:42:33 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:42:33 user nova-compute[74903]:   </cpu>
Nov 06 06:42:33 user nova-compute[74903]:   <devices>
Nov 06 06:42:33 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:42:33 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:42:33 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk"/>
Nov 06 06:42:33 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:42:33 user nova-compute[74903]:     </disk>
Nov 06 06:42:33 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:42:33 user nova-compute[74903]:       <mac address="fa:16:3e:7a:ec:e0"/>
Nov 06 06:42:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:42:33 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:42:33 user nova-compute[74903]:       <target dev="tap0927b105-d2"/>
Nov 06 06:42:33 user nova-compute[74903]:     </interface>
Nov 06 06:42:33 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:42:33 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/console.log" append="off"/>
Nov 06 06:42:33 user nova-compute[74903]:     </serial>
Nov 06 06:42:33 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:42:33 user nova-compute[74903]:     <video>
Nov 06 06:42:33 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:42:33 user nova-compute[74903]:     </video>
Nov 06 06:42:33 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:42:33 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:42:33 user nova-compute[74903]:     </rng>
Nov 06 06:42:33 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:42:33 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:42:33 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:42:33 user nova-compute[74903]:     </memballoon>
Nov 06 06:42:33 user nova-compute[74903]:   </devices>
Nov 06 06:42:33 user nova-compute[74903]: </domain>
Nov 06 06:42:33 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-956198586',display_name='tempest-TestStampPattern-server-956198586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-956198586',id=51,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-3u9lzw9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:42:31Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=7eedbb73-8439-487d-948e-3feb804c5508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG os_vif [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79300ca4-5d56-5ea7-b982-ab13725ea325', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0927b105-d2, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0927b105-d2, col_values=(('qos', UUID('7372fd67-9da0-4b61-9168-c07094922e9a')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0927b105-d2, col_values=(('external_ids', {'iface-id': '0927b105-d279-48a3-a741-9039d48fff80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ec:e0', 'vm-uuid': '7eedbb73-8439-487d-948e-3feb804c5508'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:33 user nova-compute[74903]: INFO os_vif [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2')
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No VIF found with MAC fa:16:3e:7a:ec:e0, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated VIF entry in instance network info cache for port 0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG nova.network.neutron [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-960bc019-15e6-4eef-b849-efffe600cd88 req-715bfd83-7f83-4689-9aaf-86b1c4453ae3 service nova] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing instance network info cache due to event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.compute.manager [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] No waiting events found dispatching network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:34 user nova-compute[74903]: WARNING nova.compute.manager [req-a6dc75f9-a012-4c73-8a36-e71d70037e6e req-0b7d2cfd-0cd1-4e35-aad2-bd092a7bf941 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received unexpected event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 for instance with vm_state building and task_state spawning.
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated VIF entry in instance network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG nova.network.neutron [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92e63147-2637-4659-9ce5-a992c6d8d935 req-57693293-0f27-4ab5-bf35-f9620f050a11 service nova] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:42:36 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Instance spawned successfully.
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_cdrom_bus of ide {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_disk_bus of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_video_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Found default for hw_vif_model of virtio {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:42:36 user nova-compute[74903]: INFO nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:42:36 user nova-compute[74903]: INFO nova.compute.manager [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Took 6.25 seconds to build instance.
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-6924d0e1-3097-416c-ac0e-02e6e2f832d0 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.350s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] No waiting events found dispatching network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:36 user nova-compute[74903]: WARNING nova.compute.manager [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received unexpected event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 for instance with vm_state active and task_state None.
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.compute.manager [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing instance network info cache due to event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG nova.network.neutron [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:36 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.013s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:36 user nova-compute[74903]: INFO nova.compute.manager [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Rebooting instance
Nov 06 06:42:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated VIF entry in instance network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG nova.network.neutron [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-28b166ef-4b06-45bd-9b2c-69c1e7f33d5e req-aad7cc0e-5028-4a77-ad6b-b9ecb357fb71 service nova] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG nova.network.neutron [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:37 user nova-compute[74903]: DEBUG nova.compute.manager [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:42:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:40 user nova-compute[74903]: DEBUG nova.compute.manager [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:40 user nova-compute[74903]: WARNING nova.compute.manager [req-92cb92c8-e5af-4671-890d-3daa0b69af7e req-10b52016-2120-42bc-9b27-5c1e2e4af491 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state active and task_state reboot_started.
Nov 06 06:42:40 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance shutdown successfully.
Nov 06 06:42:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG nova.compute.manager [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:42 user nova-compute[74903]: WARNING nova.compute.manager [req-f2fb372f-283f-4b77-a1a5-29fdf016762c req-4811525a-4532-4ccc-88ca-c2f7bbcfe407 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state active and task_state reboot_started.
Nov 06 06:42:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Triggering sync for uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:42 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:42:43 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:44 user nova-compute[74903]: WARNING nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state active and task_state reboot_started.
Nov 06 06:42:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:42:44 user nova-compute[74903]: WARNING nova.compute.manager [req-56cabe7d-c6d0-49f7-a994-1ca38c242982 req-260fb710-ad20-4ccb-913c-0f864478c4e4 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state active and task_state reboot_started.
Nov 06 06:42:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance running successfully.
Nov 06 06:42:44 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance soft rebooted successfully.
Nov 06 06:42:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-27d4a12c-93a7-4c07-822a-3a09a80c34f2 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.801s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.897s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:44 user nova-compute[74903]: INFO nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] During sync_power_state the instance has a pending task (reboot_started). Skip.
Nov 06 06:42:44 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:42:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:42:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.04322052001953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance aab1da5d-ecd4-4263-a3da-e293118c7051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:42:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:42:54 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:42:54 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:42:54 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:42:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:42:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:42:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:43:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:43:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:43:45 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:43:46 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:43:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:43:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74903) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 06:43:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:43:53 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8840MB free_disk=25.040771484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance aab1da5d-ecd4-4263-a3da-e293118c7051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:43:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:43:55 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:43:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:44:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:44:06 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:44:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-changed-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.compute.manager [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing instance network info cache due to event network-changed-0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing network info cache for port 0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated VIF entry in instance network info cache for port 0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.network.neutron [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-4f4532ec-9b9f-425d-8191-5052e6c7d93f req-eb1bd28c-3874-4160-88c7-59c241c0b910 service nova] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:22 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:23 user nova-compute[74903]: INFO nova.compute.manager [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Attaching volume aecc89e9-01ad-447d-bac2-3b65bf2fc265 to /dev/vdb
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.utils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0df2ff-1e0a-4e28-ad76-7f156262fe3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a140a-3806-47b0-9260-d96ff3091f6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69f064-0223-4b46-937a-51c7c1cb5caa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e82cd66-280b-4436-b509-865898375db2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:44:23 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:44:23 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd9523-a021-400c-8311-51eb10c5b265]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG os_brick.utils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating existing volume attachment record: 6f1d8e9d-565b-43f6-b341-42d21b8895e4 {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:44:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG nova.compute.manager [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing instance network info cache due to event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:44:28 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated VIF entry in instance network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-5c0fac58-3bf6-4245-a690-d42e64f10164 req-ecc014d0-e0df-4324-a711-30c476f2cb0e service nova] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.compute.manager [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing instance network info cache due to event network-changed-8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.network.neutron [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Refreshing network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:29 user nova-compute[74903]: INFO nova.compute.manager [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Detaching volume 55a98f73-a724-45a0-8007-6f720743c8cd
Nov 06 06:44:29 user nova-compute[74903]: INFO nova.virt.block_device [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Attempting to driver detach volume 55a98f73-a724-45a0-8007-6f720743c8cd from mountpoint /dev/vdb
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Attempting to detach device vdb from instance aab1da5d-ecd4-4263-a3da-e293118c7051 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:44:29 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:44:29 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:44:29 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:44:29 user nova-compute[74903]:   <serial>55a98f73-a724-45a0-8007-6f720743c8cd</serial>
Nov 06 06:44:29 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:44:29 user nova-compute[74903]: </disk>
Nov 06 06:44:29 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:44:29 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully detached device vdb from instance aab1da5d-ecd4-4263-a3da-e293118c7051 from the persistent domain config.
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aab1da5d-ecd4-4263-a3da-e293118c7051 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:44:29 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:44:29 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:44:29 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:44:29 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:44:29 user nova-compute[74903]:   <serial>55a98f73-a724-45a0-8007-6f720743c8cd</serial>
Nov 06 06:44:29 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:44:29 user nova-compute[74903]: </disk>
Nov 06 06:44:29 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:44:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated VIF entry in instance network info cache for port 8506e7fe-a38d-4c3e-a0ff-66a279de81ea. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:44:30 user nova-compute[74903]: DEBUG nova.network.neutron [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:44:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-3002e30f-bc5f-421d-bb35-d377a68ac9f6 req-7b9c7743-78f6-435c-887a-42f9160870c8 service nova] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:44:30 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:44:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:33 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:38 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhKqnGwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:44:43 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:44:43 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:44:43 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[19572488-d23d-4cee-bc65-9fb8a3d5fece]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:44:43 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5020e7-7e67-427c-bfe1-a1255456fbd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265] added
Nov 06 06:44:43 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed27ee-00ba-4f79-8583-388060591537]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f5b9fa-ba81-4f00-92b2-c6bb4459f992]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:43 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhKqnGwZ {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VhKqnGwZ" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf104e5-9346-4d59-8bcb-1ce7322e94d7]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VhKqnGwZ'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b375b4-82ea-4b34-99ac-74be3029537f]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39d544-5580-4529-842d-6d6f0f6135bc]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[884b3e52-276a-41f8-9a17-49738105383c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260]
Nov 06 06:44:44 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260] successful.
Nov 06 06:44:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574ce46-ffd9-4f68-81ca-28f3874c8d86]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d128298-dc67-4bfe-ab1c-16392bafc37f]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:44 user nova-compute[74903]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:44:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:44 user nova-compute[74903]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:44:44 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6c292-d56e-4c49-abf9-2f195950997b]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:44 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhKqnGwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23065633434303338', 'path': '/dev/sdc'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065633434303338', 'path': '/dev/sdc'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.objects.instance [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:44:45 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:44:45 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:44:45 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:44:45 user nova-compute[74903]:   <serial>aecc89e9-01ad-447d-bac2-3b65bf2fc265</serial>
Nov 06 06:44:45 user nova-compute[74903]: </disk>
Nov 06 06:44:45 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No VIF found with MAC fa:16:3e:7a:ec:e0, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:44:45 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-0c6104c3-73d4-4c44-9692-04e11f28a15b tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.665s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [{"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-aab1da5d-ecd4-4263-a3da-e293118c7051" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:44:47 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:48 user nova-compute[74903]: INFO nova.compute.manager [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Detaching volume aecc89e9-01ad-447d-bac2-3b65bf2fc265
Nov 06 06:44:48 user nova-compute[74903]: INFO nova.virt.block_device [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Attempting to driver detach volume aecc89e9-01ad-447d-bac2-3b65bf2fc265 from mountpoint /dev/vdb
Nov 06 06:44:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Attempting to detach device vdb from instance 7eedbb73-8439-487d-948e-3feb804c5508 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:44:48 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:44:48 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:44:48 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:44:48 user nova-compute[74903]:   <serial>aecc89e9-01ad-447d-bac2-3b65bf2fc265</serial>
Nov 06 06:44:48 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:44:48 user nova-compute[74903]: </disk>
Nov 06 06:44:48 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:44:48 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully detached device vdb from instance 7eedbb73-8439-487d-948e-3feb804c5508 from the persistent domain config.
Nov 06 06:44:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eedbb73-8439-487d-948e-3feb804c5508 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:44:48 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:44:48 user nova-compute[74903]:   <source dev="/dev/sdc"/>
Nov 06 06:44:48 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:44:48 user nova-compute[74903]:   <serial>aecc89e9-01ad-447d-bac2-3b65bf2fc265</serial>
Nov 06 06:44:48 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:44:48 user nova-compute[74903]: </disk>
Nov 06 06:44:48 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:44:48 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:49 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:44:50 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance aab1da5d-ecd4-4263-a3da-e293118c7051 is timed out.
Nov 06 06:44:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully detached device vdb from instance aab1da5d-ecd4-4263-a3da-e293118c7051 from the live domain config.
Nov 06 06:44:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wuYmEgzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:44:50 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b2614-e91d-46e9-b047-59dff6a7cb9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:44:50 user nova-compute[74903]: No targets found.
Nov 06 06:44:50 user nova-compute[74903]: iSNS:
Nov 06 06:44:50 user nova-compute[74903]: No targets found.
Nov 06 06:44:50 user nova-compute[74903]: STATIC:
Nov 06 06:44:50 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd
Nov 06 06:44:50 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:44:50 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:44:50 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265
Nov 06 06:44:50 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:44:50 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:44:50 user nova-compute[74903]: FIRMWARE:
Nov 06 06:44:50 user nova-compute[74903]: No targets found.
Nov 06 06:44:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:44:50 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:44:50 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7422e11-4288-40fa-840b-b752a730b5f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1fe449-9b8a-41b5-b957-c6972fcb9b75]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:50 user nova-compute[74903]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:44:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd (non-flash)
Nov 06 06:44:50 user nova-compute[74903]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:44:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa086bcb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ab851-d626-45ee-8ea2-edea0abca7ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a2e349-d94b-46e2-b3b1-8658f8d81d91]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921154d-2279-4276-8577-d72f881c3033]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc00be-634d-4078-8b79-a7239ef8040f]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b62345b-4675-4d4a-a96a-0eb0dbde70a2]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76ef46f-fce6-4453-81b8-047fc393b055]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260]
Nov 06 06:44:50 user nova-compute[74903]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd, portal: 172.16.0.220,3260] successful.
Nov 06 06:44:50 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55a98f73-a724-45a0-8007-6f720743c8cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8a0c4-e102-4eb9-8f05-a936593fe00c]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] <== disconnect_volume: return (286ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:44:50 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:44:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'flavor' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:44:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-fca9f266-b992-4ad6-bec3-5d9494ec66f7 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:44:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:53 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:44:55 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:44:55 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.039417266845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance aab1da5d-ecd4-4263-a3da-e293118c7051 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:44:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:44:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:44:58 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:08 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:09 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eedbb73-8439-487d-948e-3feb804c5508 is timed out.
Nov 06 06:45:09 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully detached device vdb from instance 7eedbb73-8439-487d-948e-3feb804c5508 from the live domain config.
Nov 06 06:45:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VhKqnGwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:45:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6b542-567b-489e-bb83-4e8ea08383bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:45:09 user nova-compute[74903]: No targets found.
Nov 06 06:45:09 user nova-compute[74903]: iSNS:
Nov 06 06:45:09 user nova-compute[74903]: No targets found.
Nov 06 06:45:09 user nova-compute[74903]: STATIC:
Nov 06 06:45:09 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265
Nov 06 06:45:09 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:45:09 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:45:09 user nova-compute[74903]: FIRMWARE:
Nov 06 06:45:09 user nova-compute[74903]: No targets found.
Nov 06 06:45:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:45:09 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:45:09 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e1d6f-bbba-4931-8bfc-a26cdb94ac07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c7bc42-5156-4309-b5ca-2180152ffa75]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:45:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 (non-flash)
Nov 06 06:45:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa08609cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265'): ({'sdc'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Removing single pathed devices sdc {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af5136a-a204-41c7-b71d-a6d259a6c1f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b875dca-7128-4ac0-86f0-bf08713f485d]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flushing IO for device /dev/sdc {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7d6a25-7f74-4bf0-989a-1092b1376ec1]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a591ea-717a-4c0c-a0f8-20108ff59137]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] SCSI volumes sdc have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26584df-b2a2-4801-b57d-bd127a51ae2b]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[111c8a90-88ac-47c3-aa5c-5dd6bae15e19]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260]
Nov 06 06:45:09 user nova-compute[74903]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265, portal: 172.16.0.220,3260] successful.
Nov 06 06:45:09 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aecc89e9-01ad-447d-bac2-3b65bf2fc265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb83957-8028-471c-b513-ba6b3e222c62]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== disconnect_volume: return (262ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:45:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:45:10 user nova-compute[74903]: DEBUG nova.objects.instance [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:45:10 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-cf035e54-ad43-49d1-bc8f-cd1e3dbee30d tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:13 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:45:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:28 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:30 user nova-compute[74903]: INFO nova.compute.manager [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Terminating instance
Nov 06 06:45:30 user nova-compute[74903]: DEBUG nova.compute.manager [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.compute.manager [req-964a12df-bda7-4fec-8351-0490f6cdf76b req-27d0f57a-1e61-4aba-80f9-56d9bdad21ce service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with task_state deleting. {{(pid=74903) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Instance destroyed successfully.
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.objects.instance [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lazy-loading 'resources' on Instance uuid aab1da5d-ecd4-4263-a3da-e293118c7051 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:40:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1925980554',display_name='tempest-TestMinimumBasicScenario-server-1925980554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1925980554',id=50,image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOtdDUY/aMktU7xrxqxbu0kU3ken1UmjI/TQYlQtqVW/3n+qWHazUv2TFRvqAJFjStk5/+ZfQulMs6imfIa3D2b/D6KVILU3aJ20nC6NybJsveQX529mpqsNfx3zIu9rg==',key_name='tempest-TestMinimumBasicScenario-80218171',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f674ff95744117a8e1e77c7d5953ba',ramdisk_id='',reservation_id='r-8v3zm0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77cca7d9-a26c-43bc-b37a-a90ba5bd83fc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1990117235',owner_user_name='tempest-TestMinimumBasicScenario-1990117235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:42:45Z,user_data=None,user_id='4438973277784443b1dcc671adaac185',uuid=aab1da5d-ecd4-4263-a3da-e293118c7051,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converting VIF {"id": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "address": "fa:16:3e:88:f4:31", "network": {"id": "5fd4c1c2-617f-4732-bba6-10f2d929df10", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1761634841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f674ff95744117a8e1e77c7d5953ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8506e7fe-a3", "ovs_interfaceid": "8506e7fe-a38d-4c3e-a0ff-66a279de81ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG os_vif [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8506e7fe-a3, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0f63293-eedc-481a-a6ec-b037d8ce24ec) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:31 user nova-compute[74903]: INFO os_vif [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:f4:31,bridge_name='br-int',has_traffic_filtering=True,id=8506e7fe-a38d-4c3e-a0ff-66a279de81ea,network=Network(5fd4c1c2-617f-4732-bba6-10f2d929df10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8506e7fe-a3')
Nov 06 06:45:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Deleting instance files /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051_del
Nov 06 06:45:31 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Deletion of /opt/stack/data/nova/instances/aab1da5d-ecd4-4263-a3da-e293118c7051_del complete
Nov 06 06:45:31 user nova-compute[74903]: INFO nova.compute.manager [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 06 06:45:31 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:45:31 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:45:32 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Took 1.04 seconds to deallocate network for instance.
Nov 06 06:45:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:32 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Deleted allocations for instance aab1da5d-ecd4-4263-a3da-e293118c7051
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-7fd7e48d-5562-456a-81f4-f26398820577 tempest-TestMinimumBasicScenario-1990117235 tempest-TestMinimumBasicScenario-1990117235-project-member] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:33 user nova-compute[74903]: WARNING nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state deleted and task_state None.
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:33 user nova-compute[74903]: WARNING nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state deleted and task_state None.
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:33 user nova-compute[74903]: WARNING nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state deleted and task_state None.
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:33 user nova-compute[74903]: WARNING nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-unplugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state deleted and task_state None.
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Acquiring lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] Lock "aab1da5d-ecd4-4263-a3da-e293118c7051-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] No waiting events found dispatching network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:45:33 user nova-compute[74903]: WARNING nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received unexpected event network-vif-plugged-8506e7fe-a38d-4c3e-a0ff-66a279de81ea for instance with vm_state deleted and task_state None.
Nov 06 06:45:33 user nova-compute[74903]: DEBUG nova.compute.manager [req-eb4ea297-e1e5-4fb2-ab13-9aff0626ace6 req-05d386f0-e23e-4391-b6c7-9468c0961695 service nova] [instance: aab1da5d-ecd4-4263-a3da-e293118c7051] Received event network-vif-deleted-8506e7fe-a38d-4c3e-a0ff-66a279de81ea {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:36 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:41 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:46 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:45:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:45:50 user nova-compute[74903]: INFO nova.compute.manager [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] instance snapshotting
Nov 06 06:45:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Beginning live snapshot process
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json -f qcow2 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da --force-share --output=json" returned: 0 in 0.175s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e.delta 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:50 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b6dc1b71a33048dfaa1347e252af6f874a36a4da,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e.delta 1073741824" returned: 0 in 0.050s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:50 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 06:45:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:45:51 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:45:51 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:52 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74903) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 06:45:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 06:45:52 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:45:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e.delta /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:52 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e.delta /opt/stack/data/nova/instances/snapshots/tmpay788scc/7550686c155642bc8566cb6d6dba2b0e" returned: 0 in 0.519s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:52 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Snapshot extracted, beginning image upload
Nov 06 06:45:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:45:54 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:45:54 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.017513275146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:54 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:45:55 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:55 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Snapshot image upload complete
Nov 06 06:45:55 user nova-compute[74903]: INFO nova.compute.manager [None req-b1c3d67c-7f68-4925-ae45-ab43d132cacc tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Took 5.00 seconds to snapshot the instance on the hypervisor.
Nov 06 06:45:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Starting instance... {{(pid=74903) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:56 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74903) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 06:45:56 user nova-compute[74903]: INFO nova.compute.claims [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Claim successful on node user
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Start building networks asynchronously for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Allocating IP information in the background. {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] allocate_for_instance() {{(pid=74903) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 06:45:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Start building block device mappings for instance. {{(pid=74903) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.policy [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db792d563e55434f9eefcbf3c27aef9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7432b75dfcb43418153f5d4f5d7e617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74903) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Start spawning the instance on the hypervisor. {{(pid=74903) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Creating instance directory {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 06:45:57 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Creating image(s)
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "/opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "/opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "/opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.part --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Successfully created port: bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG nova.virt.images [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] 77123924-a423-477c-b265-bf0397670b9b was qcow2, converting to raw {{(pid=74903) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG nova.privsep.utils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74903) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 06:45:58 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.part /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.converted {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.part /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.converted" returned: 0 in 0.558s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.converted --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f.converted --force-share --output=json" returned: 0 in 0.251s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.239s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Successfully updated port: bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG nova.compute.manager [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing instance network info cache due to event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] Acquiring lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] Acquired lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG nova.network.neutron [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing network info cache for port bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:45:59 user nova-compute[74903]: DEBUG nova.network.neutron [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json" returned: 0 in 0.188s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f,backing_fmt=raw /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk 1073741824 {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.neutron [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f,backing_fmt=raw /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk 1073741824" returned: 0 in 0.060s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "08c012a2de7cb3721b7416c997f057d399b2ab8f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9c71e54b-6955-4498-b6d5-a35285a281cf req-34f23f5d-9f22-461c-8d4a-9e1b80777165 service nova] Releasing lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquired lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Building network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance cache missing network info. {{(pid=74903) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/08c012a2de7cb3721b7416c997f057d399b2ab8f --force-share --output=json" returned: 0 in 0.177s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Created local disks {{(pid=74903) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Ensure instance console log exists: /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/console.log {{(pid=74903) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.neutron [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Releasing lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance network_info: |[{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74903) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Start _get_guest_xml network_info=[{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d4dc09ad7c2aa03438b46c2a2fcc26d0',container_format='bare',created_at=2023-11-06T06:45:50Z,direct_url=<?>,disk_format='qcow2',id=77123924-a423-477c-b265-bf0397670b9b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1063486968',owner='d7432b75dfcb43418153f5d4f5d7e617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:45:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '77123924-a423-477c-b265-bf0397670b9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 06:46:00 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:46:00 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU controller missing on host. {{(pid=74903) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.host [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU controller found on host. {{(pid=74903) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74903) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T05:51:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d4dc09ad7c2aa03438b46c2a2fcc26d0',container_format='bare',created_at=2023-11-06T06:45:50Z,direct_url=<?>,disk_format='qcow2',id=77123924-a423-477c-b265-bf0397670b9b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1063486968',owner='d7432b75dfcb43418153f5d4f5d7e617',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T06:45:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flavor limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Image limits 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flavor pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Image pref 0:0:0 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Got 1 possible topologies {{(pid=74903) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.hardware [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74903) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1634961847',display_name='tempest-TestStampPattern-server-1634961847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1634961847',id=52,image_ref='77123924-a423-477c-b265-bf0397670b9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-6u4r7n1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7eedbb73-8439-487d-948e-3feb804c5508',image_min_disk='1',image_min_ram='0',image_owner_id='d7432b75dfcb43418153f5d4f5d7e617',image_owner_project_name='tempest-TestStampPattern-1392602142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1392602142-project-member',image_user_id='db792d563e55434f9eefcbf3c27aef9c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:45:57Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=c263312e-eacf-44de-b1f1-2566a9972a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74903) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.objects.instance [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'pci_devices' on Instance uuid c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] End _get_guest_xml xml=<domain type="kvm">
Nov 06 06:46:00 user nova-compute[74903]:   <uuid>c263312e-eacf-44de-b1f1-2566a9972a79</uuid>
Nov 06 06:46:00 user nova-compute[74903]:   <name>instance-00000034</name>
Nov 06 06:46:00 user nova-compute[74903]:   <memory>524288</memory>
Nov 06 06:46:00 user nova-compute[74903]:   <vcpu>1</vcpu>
Nov 06 06:46:00 user nova-compute[74903]:   <metadata>
Nov 06 06:46:00 user nova-compute[74903]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 06:46:00 user nova-compute[74903]:       <nova:package version="0.0.0"/>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:name>tempest-TestStampPattern-server-1634961847</nova:name>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:creationTime>2023-11-06 06:46:00</nova:creationTime>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:flavor name="m1.tiny">
Nov 06 06:46:00 user nova-compute[74903]:         <nova:memory>512</nova:memory>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:disk>1</nova:disk>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:swap>0</nova:swap>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:vcpus>1</nova:vcpus>
Nov 06 06:46:00 user nova-compute[74903]:       </nova:flavor>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:owner>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:user uuid="db792d563e55434f9eefcbf3c27aef9c">tempest-TestStampPattern-1392602142-project-member</nova:user>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:project uuid="d7432b75dfcb43418153f5d4f5d7e617">tempest-TestStampPattern-1392602142</nova:project>
Nov 06 06:46:00 user nova-compute[74903]:       </nova:owner>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:root type="image" uuid="77123924-a423-477c-b265-bf0397670b9b"/>
Nov 06 06:46:00 user nova-compute[74903]:       <nova:ports>
Nov 06 06:46:00 user nova-compute[74903]:         <nova:port uuid="bb2f6aa4-58ac-4a13-9438-e521a9dea89a">
Nov 06 06:46:00 user nova-compute[74903]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 06:46:00 user nova-compute[74903]:         </nova:port>
Nov 06 06:46:00 user nova-compute[74903]:       </nova:ports>
Nov 06 06:46:00 user nova-compute[74903]:     </nova:instance>
Nov 06 06:46:00 user nova-compute[74903]:   </metadata>
Nov 06 06:46:00 user nova-compute[74903]:   <sysinfo type="smbios">
Nov 06 06:46:00 user nova-compute[74903]:     <system>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="product">OpenStack Nova</entry>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="version">0.0.0</entry>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="serial">c263312e-eacf-44de-b1f1-2566a9972a79</entry>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="uuid">c263312e-eacf-44de-b1f1-2566a9972a79</entry>
Nov 06 06:46:00 user nova-compute[74903]:       <entry name="family">Virtual Machine</entry>
Nov 06 06:46:00 user nova-compute[74903]:     </system>
Nov 06 06:46:00 user nova-compute[74903]:   </sysinfo>
Nov 06 06:46:00 user nova-compute[74903]:   <os>
Nov 06 06:46:00 user nova-compute[74903]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 06:46:00 user nova-compute[74903]:     <boot dev="hd"/>
Nov 06 06:46:00 user nova-compute[74903]:     <smbios mode="sysinfo"/>
Nov 06 06:46:00 user nova-compute[74903]:   </os>
Nov 06 06:46:00 user nova-compute[74903]:   <features>
Nov 06 06:46:00 user nova-compute[74903]:     <acpi/>
Nov 06 06:46:00 user nova-compute[74903]:     <apic/>
Nov 06 06:46:00 user nova-compute[74903]:     <vmcoreinfo/>
Nov 06 06:46:00 user nova-compute[74903]:   </features>
Nov 06 06:46:00 user nova-compute[74903]:   <clock offset="utc">
Nov 06 06:46:00 user nova-compute[74903]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 06:46:00 user nova-compute[74903]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 06:46:00 user nova-compute[74903]:     <timer name="hpet" present="no"/>
Nov 06 06:46:00 user nova-compute[74903]:   </clock>
Nov 06 06:46:00 user nova-compute[74903]:   <cpu mode="custom" match="exact">
Nov 06 06:46:00 user nova-compute[74903]:     <model>Nehalem</model>
Nov 06 06:46:00 user nova-compute[74903]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 06:46:00 user nova-compute[74903]:   </cpu>
Nov 06 06:46:00 user nova-compute[74903]:   <devices>
Nov 06 06:46:00 user nova-compute[74903]:     <disk type="file" device="disk">
Nov 06 06:46:00 user nova-compute[74903]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 06:46:00 user nova-compute[74903]:       <source file="/opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk"/>
Nov 06 06:46:00 user nova-compute[74903]:       <target dev="vda" bus="virtio"/>
Nov 06 06:46:00 user nova-compute[74903]:     </disk>
Nov 06 06:46:00 user nova-compute[74903]:     <interface type="ethernet">
Nov 06 06:46:00 user nova-compute[74903]:       <mac address="fa:16:3e:85:d5:60"/>
Nov 06 06:46:00 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:46:00 user nova-compute[74903]:       <mtu size="1442"/>
Nov 06 06:46:00 user nova-compute[74903]:       <target dev="tapbb2f6aa4-58"/>
Nov 06 06:46:00 user nova-compute[74903]:     </interface>
Nov 06 06:46:00 user nova-compute[74903]:     <serial type="pty">
Nov 06 06:46:00 user nova-compute[74903]:       <log file="/opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/console.log" append="off"/>
Nov 06 06:46:00 user nova-compute[74903]:     </serial>
Nov 06 06:46:00 user nova-compute[74903]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 06:46:00 user nova-compute[74903]:     <video>
Nov 06 06:46:00 user nova-compute[74903]:       <model type="virtio"/>
Nov 06 06:46:00 user nova-compute[74903]:     </video>
Nov 06 06:46:00 user nova-compute[74903]:     <rng model="virtio">
Nov 06 06:46:00 user nova-compute[74903]:       <backend model="random">/dev/urandom</backend>
Nov 06 06:46:00 user nova-compute[74903]:     </rng>
Nov 06 06:46:00 user nova-compute[74903]:     <controller type="usb" index="0" model="none"/>
Nov 06 06:46:00 user nova-compute[74903]:     <memballoon model="virtio">
Nov 06 06:46:00 user nova-compute[74903]:       <stats period="10"/>
Nov 06 06:46:00 user nova-compute[74903]:     </memballoon>
Nov 06 06:46:00 user nova-compute[74903]:   </devices>
Nov 06 06:46:00 user nova-compute[74903]: </domain>
Nov 06 06:46:00 user nova-compute[74903]:  {{(pid=74903) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1634961847',display_name='tempest-TestStampPattern-server-1634961847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1634961847',id=52,image_ref='77123924-a423-477c-b265-bf0397670b9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-6u4r7n1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7eedbb73-8439-487d-948e-3feb804c5508',image_min_disk='1',image_min_ram='0',image_owner_id='d7432b75dfcb43418153f5d4f5d7e617',image_owner_project_name='tempest-TestStampPattern-1392602142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1392602142-project-member',image_user_id='db792d563e55434f9eefcbf3c27aef9c',network_allocated='True',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T06:45:57Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=c263312e-eacf-44de-b1f1-2566a9972a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG os_vif [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58') {{(pid=74903) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f73ae40d-566d-56db-9943-31f46e8d8e34', '_type': 'linux-noop'}}, row=False) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb2f6aa4-58, may_exist=True, interface_attrs={}) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb2f6aa4-58, col_values=(('qos', UUID('b56e6634-0243-4e0f-97eb-87b376085a13')),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb2f6aa4-58, col_values=(('external_ids', {'iface-id': 'bb2f6aa4-58ac-4a13-9438-e521a9dea89a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:d5:60', 'vm-uuid': 'c263312e-eacf-44de-b1f1-2566a9972a79'}),), if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:00 user nova-compute[74903]: INFO os_vif [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58')
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:46:00 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No VIF found with MAC fa:16:3e:85:d5:60, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:46:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:01 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG nova.compute.manager [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] No waiting events found dispatching network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:46:02 user nova-compute[74903]: WARNING nova.compute.manager [req-1ae3883b-260f-40ea-9f60-a6cc64f39a9c req-16ac1980-ccab-4fc0-8646-958f093fde3e service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received unexpected event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a for instance with vm_state building and task_state spawning.
Nov 06 06:46:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:03 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance event wait completed in 0 seconds for  {{(pid=74903) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 06:46:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Guest created on hypervisor {{(pid=74903) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 06:46:03 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance spawned successfully.
Nov 06 06:46:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 06:46:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Found default for hw_input_bus of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:46:03 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Found default for hw_pointer_model of None {{(pid=74903) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 06:46:04 user nova-compute[74903]: INFO nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 06 06:46:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Checking state {{(pid=74903) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 06:46:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:46:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:46:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:46:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] No waiting events found dispatching network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:46:04 user nova-compute[74903]: WARNING nova.compute.manager [req-9edd0fd9-bb62-4b14-b892-5dadde6cfc7e req-cc777e0c-805d-4d49-8f1d-514b9cb296ff service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received unexpected event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a for instance with vm_state building and task_state spawning.
Nov 06 06:46:04 user nova-compute[74903]: INFO nova.compute.manager [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Took 7.21 seconds to build instance.
Nov 06 06:46:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-941f773a-1e77-4488-bfd8-4266c6efa454 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.304s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:05 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:26 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:43 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:46:49 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:46:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:46:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:46:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:46:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=24.944114685058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c263312e-eacf-44de-b1f1-2566a9972a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:46:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:46:58 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:47:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:06 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:11 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:28 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:28 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74903) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 06:47:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:47:44 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Cleaning up deleted instances {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 06:47:44 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] There are 0 instances to clean {{(pid=74903) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:47:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:47:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG nova.compute.manager [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing instance network info cache due to event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] Acquiring lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] Acquired lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:47:48 user nova-compute[74903]: DEBUG nova.network.neutron [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing network info cache for port bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updated VIF entry in instance network info cache for port bb2f6aa4-58ac-4a13-9438-e521a9dea89a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG nova.network.neutron [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-8803412d-1700-44cd-8e15-c355aee5f4e7 req-713de617-c327-419b-8c5a-c58afc0b4f8c service nova] Releasing lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:47:49 user nova-compute[74903]: INFO nova.compute.manager [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Attaching volume 9ca0b6e5-5118-4262-bb9d-147f97d92953 to /dev/vdb
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.utils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f805b-3c12-424a-b822-501f000f60c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b4464c81d0ca\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ddb7a-8af4-4487-b7f9-b65273f6ee31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[decce64a-4122-4424-9f0d-bbe1c6a007a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[347fb970-07a5-4cc3-a85d-a1856dc09ed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Running cmd (subprocess): nvme version {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] nvme not present on system {{(pid=74903) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 06:47:49 user nova-compute[74903]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 06:47:49 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27778d8b-e4b3-4252-82da-c748f4903c6a]: (4, '') {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74903) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.lightos [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] LIGHTOS: no hostnqn found. {{(pid=74903) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG os_brick.utils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b4464c81d0ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:47:49 user nova-compute[74903]: DEBUG nova.virt.block_device [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating existing volume attachment record: 2cbfedcf-07c8-4f68-9ef7-54d469959f0b {{(pid=74903) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:47:50 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:47:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:47:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:47:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:47:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=24.94329833984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c263312e-eacf-44de-b1f1-2566a9972a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing inventories for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating ProviderTree inventory for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Updating inventory in ProviderTree for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing aggregate associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, aggregates: None {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Refreshing trait associations for resource provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772, traits: COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=74903) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:47:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:47:59 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:47:59 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:05 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Calling os-brick to attach iSCSI Volume {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgtINhxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:48:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:48:09 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:48:09 user nova-compute[74903]: INFO os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 06:48:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6ab7f-2eb5-4610-a710-1440cea71d02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 06:48:09 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:09 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --interface default --op new {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac157462-b4e6-4394-bd77-bcd47640227b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953] added\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953] added
Nov 06 06:48:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[27256b31-1820-4117-8927-0b1c5efdc203]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f0a865-36e4-49cc-8ef4-451069768ba9]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgtINhxy {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgtINhxy" returned: 0 in 0.021s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d46f33-2dd2-405d-af1f-985fdffd7fe8]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AgtINhxy'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb85c1-caac-4b82-a89e-d579d9ff3e77]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69f63da-685a-4e41-a135-44effcf8d0b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:48:10 user nova-compute[74903]:  {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 06:48:10 user nova-compute[74903]:  {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:48:10 user nova-compute[74903]: WARNING os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 06:48:10 user nova-compute[74903]: 
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --login {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f688600-3c4f-4600-a5a7-989634f65e36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260]
Nov 06 06:48:10 user nova-compute[74903]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260] successful.
Nov 06 06:48:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[0100b247-2cea-4f69-8245-83b4adfe5c12]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[431cb5ca-05f1-47ee-bdf3-d9db861492a5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)
Nov 06 06:48:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)
Nov 06 06:48:10 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Connected to 172.16.0.220:3260 {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74903) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74903) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787b7fe-60af-4c8a-b45e-258252b7731f]: (4, ('- - 0', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:48:10 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74903) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgtINhxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74903) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26432643863643833', 'path': '/dev/sdb'} {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432643863643833', 'path': '/dev/sdb'} {{(pid=74903) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.objects.instance [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 06:48:11 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:48:11 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:48:11 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:48:11 user nova-compute[74903]:   <serial>9ca0b6e5-5118-4262-bb9d-147f97d92953</serial>
Nov 06 06:48:11 user nova-compute[74903]: </disk>
Nov 06 06:48:11 user nova-compute[74903]:  {{(pid=74903) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74903) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] No VIF found with MAC fa:16:3e:85:d5:60, not building metadata {{(pid=74903) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 06:48:11 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-a26ce8de-a123-435b-8927-05f27cbcc801 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.348s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:48:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:48:12 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:48:13 user nova-compute[74903]: INFO nova.compute.manager [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Detaching volume 9ca0b6e5-5118-4262-bb9d-147f97d92953
Nov 06 06:48:13 user nova-compute[74903]: INFO nova.virt.block_device [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Attempting to driver detach volume 9ca0b6e5-5118-4262-bb9d-147f97d92953 from mountpoint /dev/vdb
Nov 06 06:48:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Attempting to detach device vdb from instance c263312e-eacf-44de-b1f1-2566a9972a79 from the persistent domain config. {{(pid=74903) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 06:48:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:48:13 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:48:13 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:48:13 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:48:13 user nova-compute[74903]:   <serial>9ca0b6e5-5118-4262-bb9d-147f97d92953</serial>
Nov 06 06:48:13 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:48:13 user nova-compute[74903]: </disk>
Nov 06 06:48:13 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:48:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:13 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully detached device vdb from instance c263312e-eacf-44de-b1f1-2566a9972a79 from the persistent domain config.
Nov 06 06:48:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c263312e-eacf-44de-b1f1-2566a9972a79 from the live domain config. {{(pid=74903) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 06:48:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.guest [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 06:48:13 user nova-compute[74903]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 06:48:13 user nova-compute[74903]:   <source dev="/dev/sdb"/>
Nov 06 06:48:13 user nova-compute[74903]:   <target dev="vdb" bus="virtio"/>
Nov 06 06:48:13 user nova-compute[74903]:   <serial>9ca0b6e5-5118-4262-bb9d-147f97d92953</serial>
Nov 06 06:48:13 user nova-compute[74903]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 06:48:13 user nova-compute[74903]: </disk>
Nov 06 06:48:13 user nova-compute[74903]:  {{(pid=74903) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 06:48:13 user nova-compute[74903]: DEBUG nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 06:48:15 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:20 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:25 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:30 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:33 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c263312e-eacf-44de-b1f1-2566a9972a79 is timed out.
Nov 06 06:48:33 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully detached device vdb from instance c263312e-eacf-44de-b1f1-2566a9972a79 from the live domain config.
Nov 06 06:48:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] calling os-brick to detach iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faa286f3fd0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgtINhxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 06:48:33 user nova-compute[74903]: WARNING os_brick.initiator.connectors.base [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1dee0e-2572-4427-a788-2a8fe32b33b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 06:48:33 user nova-compute[74903]: No targets found.
Nov 06 06:48:33 user nova-compute[74903]: iSNS:
Nov 06 06:48:33 user nova-compute[74903]: No targets found.
Nov 06 06:48:33 user nova-compute[74903]: STATIC:
Nov 06 06:48:33 user nova-compute[74903]: Target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953
Nov 06 06:48:33 user nova-compute[74903]:         Portal: 172.16.0.220:3260,-1
Nov 06 06:48:33 user nova-compute[74903]:                 Iface Name: default
Nov 06 06:48:33 user nova-compute[74903]: FIRMWARE:
Nov 06 06:48:33 user nova-compute[74903]: No targets found.
Nov 06 06:48:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 06:48:33 user nova-compute[74903]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 06:48:33 user nova-compute[74903]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74903) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953', 0)] {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a0238a-fe92-45c7-9fde-36541f722c47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8daff4c-9916-4f15-99fc-403b031d9ecb]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)
Nov 06 06:48:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 (non-flash)
Nov 06 06:48:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faa287b1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953'): ({'sdb'}, set())}) {{(pid=74903) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Removing single pathed devices sdb {{(pid=74903) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[4522d136-fb8b-4878-bf48-f0e8043cf9d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ff7082-6309-49ce-9675-62e271498e97]: (4, ('ok\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Flushing IO for device /dev/sdb {{(pid=74903) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28c64f-68d9-4a33-8873-adf1ccc205bd]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74903) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b2ab83-948b-4303-bc3e-d05296f15b19]: (4, ('1', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.linuxscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] SCSI volumes sdb have been removed. {{(pid=74903) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953')] {{(pid=74903) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4e38b-d025-4bbc-ac9c-dd4daf879b72]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --logout {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c419d-cc90-4d47-8c30-c5ae89e3724d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260]
Nov 06 06:48:33 user nova-compute[74903]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953, portal: 172.16.0.220,3260] successful.
Nov 06 06:48:33 user nova-compute[74903]:  stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op delete {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca0b6e5-5118-4262-bb9d-147f97d92953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86748) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25cf93-680e-467d-94ad-4e7afb81f19e]: (4, ('', '')) {{(pid=86748) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74903) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.base [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG os_brick.initiator.connectors.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] <== disconnect_volume: return (294ms) None {{(pid=74903) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 06:48:33 user nova-compute[74903]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Disconnected iSCSI Volume {{(pid=74903) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 06:48:34 user nova-compute[74903]: DEBUG nova.objects.instance [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'flavor' on Instance uuid c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:48:34 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-5882fa11-5e37-4c74-adfa-6db946934f16 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:35 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:40 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:45 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:49 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:48:50 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Forcefully refreshing network info cache for instance {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.objects.instance [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lazy-loading 'info_cache' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.network.neutron [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:48:51 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated the network info_cache for instance {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 06:48:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:48:55 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:48:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:48:57 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=24.942337036132812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance c263312e-eacf-44de-b1f1-2566a9972a79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:48:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:49:00 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:03 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.compute.manager [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing instance network info cache due to event network-changed-bb2f6aa4-58ac-4a13-9438-e521a9dea89a. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] Acquiring lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] Acquired lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Refreshing network info cache for port bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:04 user nova-compute[74903]: INFO nova.compute.manager [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Terminating instance
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.compute.manager [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updated VIF entry in instance network info cache for port bb2f6aa4-58ac-4a13-9438-e521a9dea89a. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.network.neutron [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [{"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-f56ce410-1901-40f9-9b1f-532d1ad4fe9f req-7e44b001-de1c-4470-b7f3-ed2e98ed1e80 service nova] Releasing lock "refresh_cache-c263312e-eacf-44de-b1f1-2566a9972a79" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Instance destroyed successfully.
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.objects.instance [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'resources' on Instance uuid c263312e-eacf-44de-b1f1-2566a9972a79 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1634961847',display_name='tempest-TestStampPattern-server-1634961847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1634961847',id=52,image_ref='77123924-a423-477c-b265-bf0397670b9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-6u4r7n1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7eedbb73-8439-487d-948e-3feb804c5508',image_min_disk='1',image_min_ram='0',image_owner_id='d7432b75dfcb43418153f5d4f5d7e617',image_owner_project_name='tempest-TestStampPattern-1392602142',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1392602142-project-member',image_user_id='db792d563e55434f9eefcbf3c27aef9c',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:46:04Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=c263312e-eacf-44de-b1f1-2566a9972a79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "address": "fa:16:3e:85:d5:60", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb2f6aa4-58", "ovs_interfaceid": "bb2f6aa4-58ac-4a13-9438-e521a9dea89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG os_vif [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb2f6aa4-58, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b56e6634-0243-4e0f-97eb-87b376085a13) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:04 user nova-compute[74903]: INFO os_vif [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=bb2f6aa4-58ac-4a13-9438-e521a9dea89a,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb2f6aa4-58')
Nov 06 06:49:04 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Deleting instance files /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79_del
Nov 06 06:49:04 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Deletion of /opt/stack/data/nova/instances/c263312e-eacf-44de-b1f1-2566a9972a79_del complete
Nov 06 06:49:05 user nova-compute[74903]: INFO nova.compute.manager [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:49:05 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:49:05 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Took 0.44 seconds to deallocate network for instance.
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.compute.manager [req-20c8ec92-5fa4-4a45-9941-37938a6dce6f req-49425088-8b26-49cc-ae49-358ff43495a9 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-vif-deleted-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:49:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:05 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Deleted allocations for instance c263312e-eacf-44de-b1f1-2566a9972a79
Nov 06 06:49:05 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-743f1a62-5ee5-48d1-8163-5395788ee838 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "c263312e-eacf-44de-b1f1-2566a9972a79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-vif-unplugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] No waiting events found dispatching network-vif-unplugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:49:06 user nova-compute[74903]: WARNING nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received unexpected event network-vif-unplugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a for instance with vm_state deleted and task_state None.
Nov 06 06:49:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Acquiring lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] Lock "c263312e-eacf-44de-b1f1-2566a9972a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:06 user nova-compute[74903]: DEBUG nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] No waiting events found dispatching network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:49:06 user nova-compute[74903]: WARNING nova.compute.manager [req-edfdc7c1-6edf-431c-a0b6-1f033b8ce0d9 req-ef66bba0-ecdf-4a47-a4a7-9193d871fe78 service nova] [instance: c263312e-eacf-44de-b1f1-2566a9972a79] Received unexpected event network-vif-plugged-bb2f6aa4-58ac-4a13-9438-e521a9dea89a for instance with vm_state deleted and task_state None.
Nov 06 06:49:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:13 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:19 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:24 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:29 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:34 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:39 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:49:44 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:49 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:49:50 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:52 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:52 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:49:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:49:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:49:54 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.processutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74903) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 06:49:56 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:49:56 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:49:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.9351806640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:49:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Instance 7eedbb73-8439-487d-948e-3feb804c5508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74903) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:49:57 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:49:58 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:49:59 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:00 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:03 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:04 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:08 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:09 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:14 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:15 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:16 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-changed-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.compute.manager [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing instance network info cache due to event network-changed-0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] Acquiring lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] Acquired lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Refreshing network info cache for port 0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:17 user nova-compute[74903]: INFO nova.compute.manager [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Terminating instance
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.compute.manager [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Start destroying the instance on the hypervisor. {{(pid=74903) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updated VIF entry in instance network info cache for port 0927b105-d279-48a3-a741-9039d48fff80. {{(pid=74903) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.neutron [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [{"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-78ac2fcd-0f7e-4660-9fd1-34696dc4cb7f req-037f8a61-a058-46bd-b735-fc385b066ef0 service nova] Releasing lock "refresh_cache-7eedbb73-8439-487d-948e-3feb804c5508" {{(pid=74903) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 06:50:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Instance destroyed successfully.
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.objects.instance [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lazy-loading 'resources' on Instance uuid 7eedbb73-8439-487d-948e-3feb804c5508 {{(pid=74903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.virt.libvirt.vif [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T06:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-956198586',display_name='tempest-TestStampPattern-server-956198586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-956198586',id=51,image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKk3YBiqT66YPgDth2fNw3XMGZZ4sjg2wNFHVbQnKv3RQZYB193HKa2YiR9iGVYGT8eVC4laENLxmygdGSqqoYUxeocFoWvnWJjgtxdPxxTryzX3zTW0w33izgWXPBgGQ==',key_name='tempest-TestStampPattern-1757289838',keypairs=<?>,launch_index=0,launched_at=2023-11-06T06:42:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7432b75dfcb43418153f5d4f5d7e617',ramdisk_id='',reservation_id='r-3u9lzw9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8f85acc-7dce-4172-bf4e-a640a545c91b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1392602142',owner_user_name='tempest-TestStampPattern-1392602142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T06:45:55Z,user_data=None,user_id='db792d563e55434f9eefcbf3c27aef9c',uuid=7eedbb73-8439-487d-948e-3feb804c5508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converting VIF {"id": "0927b105-d279-48a3-a741-9039d48fff80", "address": "fa:16:3e:7a:ec:e0", "network": {"id": "47249d32-6709-413d-b148-c33f43c13bc6", "bridge": "br-int", "label": "tempest-TestStampPattern-659647874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7432b75dfcb43418153f5d4f5d7e617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0927b105-d2", "ovs_interfaceid": "0927b105-d279-48a3-a741-9039d48fff80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.os_vif_util [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2') {{(pid=74903) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG os_vif [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2') {{(pid=74903) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0927b105-d2, bridge=br-int, if_exists=True) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7372fd67-9da0-4b61-9168-c07094922e9a) {{(pid=74903) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:17 user nova-compute[74903]: INFO os_vif [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ec:e0,bridge_name='br-int',has_traffic_filtering=True,id=0927b105-d279-48a3-a741-9039d48fff80,network=Network(47249d32-6709-413d-b148-c33f43c13bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0927b105-d2')
Nov 06 06:50:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Deleting instance files /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508_del
Nov 06 06:50:17 user nova-compute[74903]: INFO nova.virt.libvirt.driver [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Deletion of /opt/stack/data/nova/instances/7eedbb73-8439-487d-948e-3feb804c5508_del complete
Nov 06 06:50:17 user nova-compute[74903]: INFO nova.compute.manager [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 06:50:17 user nova-compute[74903]: DEBUG oslo.service.loopingcall [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74903) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.compute.manager [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Deallocating network for instance {{(pid=74903) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 06:50:17 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] deallocate_for_instance() {{(pid=74903) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.network.neutron [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:50:18 user nova-compute[74903]: INFO nova.compute.manager [-] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Took 0.47 seconds to deallocate network for instance.
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-9c1295b3-8f1b-4d0e-8f0d-85fac237ea32 req-bad36c83-f085-4cc0-a1ff-7854f7eb3db3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-vif-deleted-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:50:18 user nova-compute[74903]: INFO nova.compute.manager [req-9c1295b3-8f1b-4d0e-8f0d-85fac237ea32 req-bad36c83-f085-4cc0-a1ff-7854f7eb3db3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Neutron deleted interface 0927b105-d279-48a3-a741-9039d48fff80; detaching it from the instance and deleting it from the info cache
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.network.neutron [req-9c1295b3-8f1b-4d0e-8f0d-85fac237ea32 req-bad36c83-f085-4cc0-a1ff-7854f7eb3db3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Updating instance_info_cache with network_info: [] {{(pid=74903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.compute.manager [req-9c1295b3-8f1b-4d0e-8f0d-85fac237ea32 req-bad36c83-f085-4cc0-a1ff-7854f7eb3db3 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Detach interface failed, port_id=0927b105-d279-48a3-a741-9039d48fff80, reason: Instance 7eedbb73-8439-487d-948e-3feb804c5508 could not be found. {{(pid=74903) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:50:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:18 user nova-compute[74903]: INFO nova.scheduler.client.report [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Deleted allocations for instance 7eedbb73-8439-487d-948e-3feb804c5508
Nov 06 06:50:18 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-93b828a4-942a-45a8-8145-7db7567038f3 tempest-TestStampPattern-1392602142 tempest-TestStampPattern-1392602142-project-member] Lock "7eedbb73-8439-487d-948e-3feb804c5508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-vif-unplugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] No waiting events found dispatching network-vif-unplugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:50:19 user nova-compute[74903]: WARNING nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received unexpected event network-vif-unplugged-0927b105-d279-48a3-a741-9039d48fff80 for instance with vm_state deleted and task_state None.
Nov 06 06:50:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Acquiring lock "7eedbb73-8439-487d-948e-3feb804c5508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] Lock "7eedbb73-8439-487d-948e-3feb804c5508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:19 user nova-compute[74903]: DEBUG nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] No waiting events found dispatching network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 {{(pid=74903) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 06:50:19 user nova-compute[74903]: WARNING nova.compute.manager [req-a9ef38e4-1eb1-4b28-a90d-ffeef45d3ddb req-ac1b7d18-edb1-4e2d-9199-5bba45d3ee24 service nova] [instance: 7eedbb73-8439-487d-948e-3feb804c5508] Received unexpected event network-vif-plugged-0927b105-d279-48a3-a741-9039d48fff80 for instance with vm_state deleted and task_state None.
Nov 06 06:50:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74903) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74903) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 06:50:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:51 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:52 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:50:53 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Starting heal instance info cache {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 06:50:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Rebuilding the list of instances to heal {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 06:50:53 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Didn't find any instances for network info cache update. {{(pid=74903) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 06:50:54 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:54 user nova-compute[74903]: DEBUG nova.compute.manager [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74903) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74903) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 06:50:56 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:50:56 user nova-compute[74903]: WARNING nova.virt.libvirt.driver [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=25.059791564941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74903) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74903) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.provider_tree [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed in ProviderTree for provider: ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 {{(pid=74903) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.scheduler.client.report [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Inventory has not changed for provider ff4fb787-d54c-4cc6-9e4b-13f1ebe11772 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74903) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG nova.compute.resource_tracker [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Compute_service record updated for user:user {{(pid=74903) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 06:50:56 user nova-compute[74903]: DEBUG oslo_concurrency.lockutils [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74903) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 06:50:57 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:50:59 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:01 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:02 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:02 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:51:04 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:07 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:51:10 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:12 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:51:17 user nova-compute[74903]: DEBUG oslo_service.periodic_task [None req-f1c43c66-71c6-4b83-845f-1ee403df7b61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74903) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 06:51:17 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:18 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:21 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:22 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:23 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:27 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:32 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:37 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 06:51:42 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 06:51:47 user nova-compute[74903]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 31 {{(pid=74903) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}